Abstract
In this paper, we propose a new automated procedure for lesion identification from single images based on the detection of outlier voxels. We demonstrate the utility of this procedure using artificial and real lesions. The scheme rests on two innovations: First, we augment the generative model used for combined segmentation and normalization of images, with an empirical prior for an atypical tissue class, which can be optimised iteratively. Second, we adopt a fuzzy clustering procedure to identify outlier voxels in normalised gray and white matter segments. These two advances suppress misclassification of voxels and restrict lesion identification to gray/white matter lesions respectively. Our analyses show a high sensitivity for detecting and delineating brain lesions with different sizes, locations, and textures. Our approach has important implications for the generation of lesion overlap maps of a given population and the assessment of lesion-deficit mappings. From a clinical perspective, our method should help to compute the total volume of lesion or to trace precisely lesion boundaries that might be pertinent for surgical or diagnostic purposes.
Keywords: Structural MRI, Segmentation, Lesion identification, Gray matter, White matter, Oedema, Fuzzy clustering, Outlier detection
Introduction
Precise lesion identification in subjects with structural brain damage is essential for understanding lesion-deficit mappings in the human brain. Usually, the gold-standard method for lesion identification rests on the manual definition of abnormal brain tissue by a trained professional (e.g. Bates et al., 2003; Dronkers et al., 2004; Fiez et al., 2000); however, this method is laborious, operator-dependent (e.g. Ashton et al., 2003; Filippi et al., 1995), and time-consuming. Alternatively, several semi-automated and fully automated procedures for lesion identification have been proposed (e.g. Anbeek et al., 2004; Capelle et al., 2004; Colliot et al., 2006a,b; Datta et al., 2006; Fletcher-Heath et al., 2001; Hojjatoleslami and Kruggel, 2001; Mehta et al., 2003; Prastawa et al., 2004, 2003; Ruan et al., 2007; Sajja et al., 2006; Soltanian-Zadeh et al., 1998; Stamatakis and Tyler, 2005; Wu et al., 2006; Xie et al., 2005; Zhou et al., 2005). They can be divided in two categories according to the nature of the MRI images used to identify the lesion: (i) multi-channel or multi-spectral methods that operate on several weighted MRI images, including T1, T2, PD, and FLAIR images, with or without contrast agents (e.g. Kabir et al., 2007; Prastawa et al., 2004; Ruan et al., 2007; Soltanian-Zadeh et al., 1998; Wu et al., 2006); and (ii) mono-channel or mono-spectral methods that use only one contrast MRI image (e.g. T1 image) (Hojjatoleslami and Kruggel, 2001; Jack et al., 2001; Lau and Ozawa, 2006; Stamatakis and Tyler, 2005; Wilke et al., 2003).
With the financial and time constraints on clinical studies, it is not unusual that patients participating in functional MRI studies have only one anatomical image (usually a T1 image). Several algorithms have been proposed for extracting the maximum information from only one type of MRI contrast. Although these algorithms differ in terms of sensitivity, computational complexity and applicability, we can classify them according to two characteristics: (i) whether they use a priori knowledge about the structure of normal brains; including; for instance; a set of neurotypical templates or not and, (ii) whether they use tissue segmentation techniques or not. For example, voxel-based morphometry (VBM), which uses both template priors and segmentation, can characterise structural abnormalities in either the gray or white matter by segmenting and normalising MRI images of patients and comparing them to gray or white matter segments from controls (e.g. Colliot et al., 2006a; Gitelman et al., 2001; Kassubek et al., 2002; Wilke et al., 2003; Woermann et al., 1999). However, this approach has been shown to have low statistical sensitivity for detecting lesions (Mehta et al., 2003) and critically depends on the choice of the templates (Shen et al., 2007) and processing parameters (e.g. Wilke et al., 2003). Other groups have implemented alternative methods that eschew prior knowledge and segmentation. For example, the level-set evolution framework, with deformable models is based on cortical thickness and signal gradients (Colliot et al., 2006b; Ho et al., 2002; Xie et al., 2005). However, these approaches were developed to target specific lesion types (e.g., focal cortical dysplasia) and cannot be generalised easily to other types of lesions.
Recently, Stamatakis and Tyler (2005) proposed a lesion identification technique based on the comparison of the damaged brain to a set of normal brains without segmentation. The T1 images of controls and patients were normalised to the same template, spatially smoothed, and then compared statistically voxel-by-voxel to identify regions (i.e. lesions) that differed between patients and the normal range established by the controls (Stamatakis and Tyler, 2005). However, this approach depends on potentially suboptimal normalisation and the lesions identified can be contaminated by cerebrospinal fluid (CSF).
Another factor that may influence the success of automated lesion delineation is the location of the lesion. For instance, lesions close to the ventricles, the inter-hemispheric fissure, or to the scalp might be problematic, when using some automated methods (e.g., Liu et al., 2001; Stamatakis and Tyler, 2005). In this context, segmentation procedures might help to discriminate CSF and non-brain tissue before identifying the lesion. Furthermore, the existence of a priori knowledge about the distribution of normal values (assessed from normal controls) in all brain regions is very useful, particularly when the lesion has similar signal properties to healthy tissue (e.g. gray matter malformations (Bernasconi, 2003; Wilke et al., 2003)). These considerations suggest that robust frameworks for lesion detection should include tissue segmentation and a priori knowledge.
In this context, we propose a new procedure to identify any type of brain damage given a single anatomical image. Our procedure is based on the assumption that the lesion comprises atypical voxels that disclose themselves as outliers in gray and white matter segments. Atypical voxels are those that do not correspond to the expected tissue types; i.e., are neither grey matter (GM), white matter (WM), nor cerebrospinal fluid (CSF). To avoid misclassification, the segmentation routine has to be modified to account for the atypical “extra” tissue class introduced by the lesion. Here we propose a modified version of the unified segmentation scheme (Ashburner and Friston, 2005) to segment healthy and damaged brain tissue. The unified segmentation scheme has recently been shown to provide accurate spatial normalisation for lesioned brains (Crinion et al., 2007). Outlier voxels are those that are far from the normal range of voxel values in controls (Van Leemput et al., 2001). The lesion is then identified by searching for outlier voxels in GM and WM segments. This ensures that we identify lesions that are specific to brain tissue (i.e., GM and WM). We use fuzzy clustering with fixed-prototypes (FCP), developed recently for outlier detection in second-level functional MRI analyses (Seghier et al., 2007). A few studies have tried to implement this scheme (i.e., identify unexpected and outlier voxels) in multi-spectral mode (e.g. Prastawa et al., 2003, 2004), but its applicability has not yet been demonstrated in mono-spectral mode. In this paper, we evaluate the approach with structural T1 images.
The approach is illustrated using both simulated and real patient data. We first explain the rational for using a modified segmentation procedure. We show that adding an extra class to the unified segmentation model effectively precludes the misclassification of damaged voxels as healthy GM or WM tissue. Then, the success of the modified segmentation is assessed qualitatively by ensuring that (i) GM and WM are free from contamination from the lesion and (ii) the extra class does not incorporate intact tissue. Outlier GM and WM voxels are identified by fuzzy clustering and lesion maps are then generated. Using similarity measures, we explore the sensitivity and the specificity of our method for detecting and delineating brain lesions. The results from both our artificial and real lesions demonstrate successful delineation of damaged tissue with high sensitivity.
Methods
Data sets
T1 images with simulated lesions
Ten T1-weighted images from neurologically normal subjects were modified by inserting a variety of lesions that had been derived from “real” lesioned brains. Full details of how these T1 images were created can be found in Brett et al. (2001). Essentially, the simulations involved creating a lesion definition image (i.e., a manual definition of lesioned tissue) using T1-weighted MRI images of real patients' brains with a variety of lesions. These lesion images were then inserted, “cut-and-pasted”, into T1-weighted MRI images from normal subjects. The lesions were heterogeneous, of different size, T1 signal and location (see Brett et al., 2001). Simulated case 01 had metastasis with extensive oedema; 02 had a left anterior frontal infarct near to the scalp; 03 had left anterior and mesial communicating artery aneurysm and temporoparietal infarct; 04 had dorsal and mesial cortical dysplasia; 05 had a posterior and mesial left occipitotemporal infarct; 06 had a large left frontoparietal loculated infarct; 07 had left temporoparietal infarct; 08 had focal cortical atrophy affecting the temporal lobe; 09 had a posterior and mesial left occipitotemporal infarct and 10 had an infarct in the putamen/insula (for illustration, see Fig. 2 of Crinion et al. (2007)).
In contrast to some previous studies (e.g. Mehta et al., 2003; Stamatakis and Tyler 2005), we used simulated lesions that were derived from real cases rather than using artificial lesions that do not reflect the complexity of real lesions. There are two key advantages of simulated lesions: the natural characteristics, in terms of the size and texture of the lesion, are preserved and we know a priori where the boundaries of the lesion are.
Real T1 images
T1 images were acquired from eight patients with strokes that varied in size and affected diverse regions (age 23–68 years) and sixty-four neurologically normal subjects (age 21–75 years). To test the sensitivity of our method on a wide range of lesion volumes and locations, we included: two patients with large and heterogonous frontotemporal lesions extending laterally from the ventricles to near the scalp; two patients with large occipitotemporal lesions; two patients with left hemisphere lesions near to the ventricles; one patient with a right hemispheric lesion near to the ventricles; and one patient with a small infarct close to the inter-hemispheric fissure. These real cases illustrate some of the characteristics that might challenge automated identification of lesions.
All acquisitions were performed on a 1.5 T Siemens system (Siemens Medical Systems, Erlangen, Germany). Anatomical imaging consisted of a weighted T1 GRE 3D sequence (TR/TE/Flip = 12.24 ms/ 3.56 ms/ 23°, matrix = 256 × 256, in-plane resolution = 1 × 1 mm, 176 axial slices, 1 mm thick with no gap).
Lesion identification procedure
Our approach comprises four steps:
-
•
Segmentation and normalisation of all patients and controls T1 images (allowing for a lesion tissue class).
-
•
Spatial smoothing of normalised GM and WM segments.
-
•
Detection of outlier voxels in each tissue by comparing the GM and WM segments of the patient to those of controls under fuzzy clustering.
-
•
Outlier voxels in each tissue class are assigned to the lesion (i.e., a fuzzy set).
Note that for illustration purposes we will use the simulated cases 10 and 06 to disclose the rational of each step of our automated method. Simulated case 10 has a chronic stroke affecting the insula (tissue loss) with well-defined borders and a relatively homogeneous T1 signal distribution (close to CSF signal). In contrast, simulated case 06 has a large frontoparietal, loculated lesion with diffuse borders, local mass effects and a heterogeneous T1 signal distribution (tissue loss with T1 signal near to CSF and tissue damage with T1 signal near to GM).
Segmentation of the T1 volumes
Unified segmentation-normalisation
We employed the unified procedure implemented in the SPM5 software package (Wellcome Trust Centre for Neuroimaging, London, UK, http://www.fil.ion.ucl.ac.uk/spm/) that combines segmentation, bias correction and spatial normalization through the inversion of a single unified model (for more details see Ashburner and Friston, 2005). In brief, the unified model combines tissue class, intensity bias and nonlinear warping into the same probabilistic models that are assumed to generate subject-specific images. Image intensities are modelled by mixtures of Gaussians (MOG). Within a MOG, the prior probability that a voxel intensity is drawn from a particular Gaussian is given by a mixing proportion. In the unified model, the priors on the tissue class from which intensities are drawn are encoded by deformable tissue probability maps. These are generated from the averages of affine registered and tissue classified images of 452 subjects (see Fig. 1A), provided by the International Consortium for Brain Mapping (http://www.loni.ucla.edu/ICBM/). These maps represent the probabilities of finding GM, WM, CSF and “other” tissues at each voxel. In this paper, the unified model used the default number of Gaussians {2,2,2,4} to model each of the intensity distributions of GM, WM, CSF and the “other” tissues respectively.
Throughout this work, the following parameters of the SPM5 scheme were held constant: 25 mm for the cut-off of three dimensional discrete cosine transform (DCT) basis functions for spatial warping (for more details see Ashburner and Friston, 1999), medium regularisation (see Crinion et al., 2007), and 75 mm width for the Gaussian smoothness of intensity bias fields.
Problems with the segmentation procedure
To illustrate the effectiveness of the unified segmentation using the three (plus “other”) priors shown in Fig. 1A, a normal brain and two simulated lesions (cases 10 and 06) were processed using the SPM5 segmentation routine. The normal brain was segmented as expected into GM, WM and CSF (Fig. 1B). In simulated case 10, the well-defined insular lesion is entirely classified as CSF (Fig. 1C), despite the fact that the normal priors were higher for WM than CSF at this spatial location. The lesion site was therefore classified with a low probability of being GM or WM which is important when identifying areas with abnormally low GM or WM. In contrast, for simulated case 06, a part of the lesion was misclassified as normal WM tissue (Fig. 1D), despite the fact that this tissue had a T1 signal different from the T1 signal in healthy WM. This cannot entirely be explained by the mixing of two Gaussians because the same area remained misclassified as WM even when using one Gaussian per class to model the signal distribution of each tissue. This suggests that the relatively high WM priors at this spatial localisation had biased the apparent difference in T1 signal during the optimisation procedure (for more details, see Eq. (5) in Ashburner and Friston, 2005). For our purposes, this segmentation failure will hinder lesion identification. This problem has been documented previously in patients with focal cortical dysplasia, where parts of the lesions were misclassified as intact WM (see for example Colliot et al., 2006a). A modification of the segmentation procedure therefore needs to ensure that abnormal voxels are not misclassified as GM or WM.
A modified segmentation procedure
One simple solution to the problem of misclassification of damaged tissue entails adding an “extra” class that includes the unexpected and abnormal voxels within the lesion. This is equivalent to the segmentation procedure in some multi-spectral studies that use the regions that show signal enhancement after contrast agent injection as priors (e.g. Moon et al., 2002; Prastawa et al., 2003). Although lesion location, shape, size, and signal are unknown, we show below how the priors can be approximated for the extra class in a mono-spectral mode. Before describing this extra class, we illustrate its rational by displaying the segmented images in a new way. This involves generating signal-to-probability maps that represent a scatter-plot (i.e., a voxel-by-voxel correspondence) between the T1 image (signal) and the probability of a segmented tissue type.
Fig. 2 illustrates a scatter-plot of a normal brain. Higher probability values (around 1) for WM and GM corresponded to different T1 signal ranges, suggesting a good partition between the two tissues. However, in the presence of a lesion with a heterogeneous signal, as in simulated case 06, high WM probability was also observed for voxels with a T1 signal range similar to those of the GM class (voxels indicated by an arrow in Fig. 2B). This suggests that the WM class actually contained voxels from the lesion with a T1 signal far from the normal WM signal; i.e., the WM class has become over inclusive.
The modified segmentation algorithm aims to suppress over inclusive WM and GM classes, especially when the lesion has a T1 signal in the range of WM or GM signal. By adding an extra class to the segmentation routine, we aimed to model explicitly voxels that show a discrepancy between the spatial priors and the expected T1 signal (e.g. a location in the WM but with T1 signal values close to GM). To suppress misclassified voxels (those indicated by an arrow in Fig. 2B), the priors for this extra class should exhibit the following characteristics. First, as the T1 signal in the lesion (e.g. oedema, dysplasia) and GM are comparable, the extra class should have a low probability in GM voxels to avoid incorporating normal GM voxels. Similarly, to differentiate misclassified and intact WM voxels, the extra class should have a low probability in WM voxels to ensure that normal WM are classified properly; however, as misclassified voxels are particularly evident within WM, the probability of the extra class should be higher for voxels located in WM, relative to GM, to “force” the segmentation to reclassify the misclassified tissue. Although these criteria can be satisfied by many priors for the extra class, one simple prior is the mean of WM and CSF priors:
(1) |
Where PWM and PCSF are the standard priors of WM and CSF respectively (as shown in Fig. 1A). In short, a new class is formed by taking prior probability mass from the WM and CSF classes but not the GM class (note that Pextra values in GM tissue are not zeros). This extra class provides more flexibility in the segmentation procedure, when dealing with the damaged tissue as illustrated below.
Implementing the modified segmentation
Fig. 3 illustrates how the modified segmentation routine dealt with damaged tissue in simulated case 06. By adding this extra class, the segmentation was able to classify the abnormal WM tissue (see Fig. 3A). Although most of the abnormal voxels were given a low probability of being intact WM (as can be seen when comparing Fig. 3A to Fig. 1D), some of the abnormal voxels remained misclassified as WM or GM. To improve the segmentation procedure further, the extra class was refined and then used as an empirical prior for a second segmentation on the same T1 image. To obtain a refined version of the extra class, all the voxels classified in the extra class with a probability value lower than a third were removed. This ensured that, at the same location, voxels belonging to the extra class would have a higher probability value than either GM or WM. When using this refined version of the extra prior, the second segmentation removed almost all abnormal voxels from the WM class (see Fig. 3B for more details). This is clearly visible when comparing the WM classes in Figs. 1D and 3B. Remarkably, this segmentation procedure, with two iterations and appropriate extra class priors, modelled abnormal voxels and thus minimised misclassification in GM and WM classes. Note that, at each iteration, the segmentation routine of SPM5 ensures that all priors sum to one at any voxel.
Practically, the process shown above can be iterated several times (i.e., an iterative segmentation routine): the estimated extra class acting as the prior for the next segmentation run. Here we use two iterations throughout the paper. For more details about the influence of the number of iterations, see paragraph 1 and Fig. S1 of the Supplementary material.
With two iterations, Fig. 4 shows clearly how adding an extra class improved the dissociation of normal and abnormal WM voxels. In these maps, the abnormal WM voxels (shown in black in Fig. 4A) are classified in the extra class. The final WM class is remarkably similar to a normal WM class (e.g. the scatter map of a normal subject in Fig. 2A was comparable to the one of the correctly segmented lesioned brain in Fig. 4B). Critically, we also found that adding this extra class did not alter the segmented healthy tissue when the brain is normal (for more details see paragraph 2 and Fig. S2 of the Supplementary material).
This new segmentation approach which creates 4 normalised and segmented classes per subject (i.e., normalised GM, WM, CSF and the extra class) was applied to ten brains with simulated lesions and eight brains with real lesions. For the purpose of lesion identification, only the GM and WM images were used (i.e., here we are only interested in lesions of gray and white matter).
Spatial smoothing
Before comparing the segmented images of a lesioned brain to those of controls, we need to suppress fine-scale inter-subject anatomical variability. For this purpose, the normalised and segmented GM and WM images of each subject were smoothed spatially with a Gaussian kernel of 8 mm full-width-at-half-maximum (FWHM). See paragraph 3 and Fig. S3 of the Supplementary material for more details about our reasons for selecting 8 mm smoothing. This is in line with other studies that have shown better results with intermediate smoothing values (8–12 mm) for lesion identification (e.g. Stamatakis and Tyler, 2005).
Fuzzy clustering of outliers
To identify outlier voxels, we have described previously a method based on Fuzzy Clustering with fixed Prototypes (FCP). This has been used to identify voxels where activation in a given subject is far from the mean activation of the group or population (for more details, see (Seghier et al., 2007). In the context of lesion identification, we assume that, at the global level, a lesioned brain can be considered as an outlier in relation to normal (control) brains. This assumption has been suggested for instance in some previous multi-spectral work (e.g. Jack et al., 2001; Prastawa et al., 2004; Van Leemput et al., 2001). Here, we used FCP to identify voxels that were very different in the lesioned brain as compared to controls.
The procedure is as follows: a lesioned GM segment is compared with control GM segments for each voxel i, by assessing a similarity metric Dij that represents the difference between the value of voxel i of a j-th GM fuzzy set and the mean of GM values in this voxel (with j = 1… Nsub; Nsub is the total number of subjects (i.e. number of controls plus the patient)). The similarity metric Dij is defined as:
(2) |
The real constant α is a “tuning” parameter that can be adjusted to control the sensitivity of the method to outlier values (see Fig. 3 of Seghier et al. (2007)). tanh is the hyperbolic tangent, Xij is the tissue probability for the j-th subject at voxel i, and X̄―i is the mean over subjects. The constant α is fixed at − 0.5 (the constant α is negative to test if Xij is low compared to X―i, which is in line with the definition of a lesion as an absence of normal brain tissue).
The similarity metric Dij is then used to quantify the degree of membership Uij of voxel i to class j according to the following equation:
(3) |
The parameter λ is a negative number, typically − 4. The values Uij (within the interval [0,1]) comprise the j-th fuzzy set. When j indexes the lesioned brain, the values Uij comprise the fuzzy set FGM, which represents the degree of membership of voxels that have very low GM probability in the lesioned brain, relative to controls (i.e., a GM lesion map). This procedure was repeated with WM images, yielding the fuzzy set FWM.
Grouping GM and WM lesions
From the above, we obtain two fuzzy sets FGM and FWM, representing the voxels in each lesioned brain that had a very low probability of being GM and WM voxels respectively, compared with the controls. The union, FLES of the two sets identifies the lesion (i.e., a probability of being either GM or WM). The fuzzy set union was assessed with (c.f., Ibrahim, 1997),:
(4) |
where ∪ is the set operator “union”. The operator “max” is applied over all voxels.
A schematic view of our scheme is provided in Fig. 5A. An illustration of this procedure is given in Fig. 5B with simulated case 10. Briefly, after segmentation, the tissue images were smoothed (with FWHM of 8 mm) and compared to normal tissue images from the control subjects to identify outlier voxels. These GM and WM outlier voxels are then combined to form the fuzzy set that defines the lesion. This fuzzy set can be thresholded at a given U value to generate a binary mask of the lesion (for more details about the influence of U thresholds, see paragraph 4 and Fig. S4 of the Supplementary material).
Validation of the identified lesions
At the global level, the method is judged successful if it can identify the lesion at the right location and with approximately the correct extent. At the voxel level, we assessed Dice's similarity index (Dice, 1945) between each binary lesion map (i.e. FLES at a given U threshold) and the “real” lesion (considered as true positives) using the following formula:
(5) |
where TP, FP, and FN represent the number of true positives, false positives, and false negatives respectively (for a similar rational see Sajja et al., 2006; Stamatakis and Tyler, 2005). Because the lesion is a fuzzy set (i.e. FLES contained values between 0 and 1), the Dice index was generated at several U thresholds (c.f. Anbeek et al., 2004). To assess the specificity and the sensitivity of our method, we also generated receiver operating characteristic (ROC) curves (e.g. Metz, 1978) that encode the dependence of the true positive rate (sensitivity) on the false positive rate (one minus specificity) for different U thresholds.
For simulated lesions, the “real” (true) abnormal voxels are approximately known (inserted with the cut/paste procedure as explained above). For real cases, all lesions were manually segmented by an expert (A.P.L) and the resultant masks are thus considered as true voxels.
Results
Definition of simulated lesion boundaries
At the voxel level, we illustrate the sensitivity of the method on simulated cases 06 and 10 (those presented in Fig. 1C and D). Fig. 6A shows the Dice similarity index at different U thresholds. At low U values (e.g. U < 0.05), the Dice index was small due to high false positive rates. The Dice index reached high values (> 0.7) at intermediate U values suggesting a remarkable correspondence between the identified lesions and the known simulated lesions. The method is also highly sensitive and specific as illustrated by the ROC curves (i.e. curves near to the top-left corner). At the global level, the boundaries of all simulated lesions are shown in Fig. 6B. All lesions were identified successfully, including the extensive oedema in simulated case 01, both the aneurysm and infarct in simulated case 03, dysplasia in simulated case 04, large tissue loss and tissue damage in simulated case 06 and atrophy in simulated case 08. Critically, although a low U threshold was used (U = 0.1) in Fig. 6B, false positives (i.e., intact tissue identified as damaged) were very limited (e.g. brainstem of simulated case 05 and WM tracks in simulated case 07).
Definition of real lesion boundaries
Given real patient scans, the method was able to identify automatically, and without exception, a wide range of lesions. Fig. 7 shows the ROC curves of the eight real cases. Compared to the manual segmentation (i.e. that defines the “true” abnormal voxels), our method is highly sensitive and specific for these different lesions. The Dice index is on average 0.64 ± 0.1 with a maximum at 0.81. One real case has a small Dice index (0.53) due to non-overlapping voxels between the manual segmentation and our method, in particular near to the ventricles (see Fig. 8C below), despite lesions identified at the right location.
Patients with extensive lesions are shown in Fig. 8. In these four cases, lesions were identified correctly, including massive tissue loss (Fig. 8A) and extensive tissue damage in different parts of the brain (Fig. 8B–D). More challenging cases were the patients with tissue loss near to the ventricles (i.e., comparable T1 signal in lesions and ventricles). Fig. 9 shows the results in three patients; the boundaries of the lesions appear well distinguished from the ventricles, which confirms that our procedure minimised any contamination from ventricles during lesion identification. Lesion identification was successful in both left (Fig. 9A–B) and right hemispheres (Fig. 9C). The last real case is shown in Fig. 9D. The method was remarkably successful in this case, despite a lesion near the inter-hemispheric fissure (Fig. 9D).
Discussion
In this paper, we propose a new automated procedure for lesion identification from single images based on the detection of outlier voxels. We have demonstrated the utility of this procedure on multiple artificial and real lesions. Our findings show the high sensitivity of the method for detecting and delineating brain lesions with different sizes, locations, and textures. Our approach has important applications for the generation of lesion overlap maps of a given population (e.g. Frank et al., 1997; Makale et al., 2002) and the assessment of lesion-deficit mappings (Bates et al., 2003; Damasio et al., 2004; Karnath et al., 2004; Solomon et al., 2007; Tyler et al., 2005).
The rational for using this method is motivated by the following points: (i) this method is suitable when only one type of image (e.g., T1 image) is available; (ii) intensities in the segmented classes are automatically normalised into the interval 0 to 1 for each subject, which should minimise the influence of MR signal non-uniformities (Hou, 2006) that may hinder the detection of lesion from T1 volumes (e.g. Stamatakis and Tyler 2005); (iii) the analysis was performed on voxels within the tissues of interest (GM and WM) avoiding contributions from the CSF and non-brain classes; (iv) it can assess the lesion effect specifically for each brain tissue; e.g., GM malformations; (v) the existence of the lesion is modelled explicitly as an extra class during brain segmentation, which helps to avoid misclassification of damaged voxels; (vi) identified lesions are mapped directly in a stereotaxic space (e.g. Rorden and Brett, 2000); (vii) the algorithm is based on optimal normalisation (i.e. the unified segmentation–normalisation framework) that has been shown to be accurate and robust when dealing with lesioned brains (Crinion et al., 2007); (viii) the algorithm for outlier detection is based on the pragmatic theory of fuzzy sets; (ix) the categorisation of a voxel as intact or abnormal is based on the distribution of normal values of GM and WM in healthy subjects; (x) identified lesions are coded as continuous values thereby quantifying the degree of abnormality of each voxel.
Some methodological factors may limit the sensitivity of our method. The spatial smoothing used here to minimise inter-subject anatomical variability during the identification of outliers obviously has an influence on the sensitivity and specificity of the method. In line with previous reports (e.g. Stamatakis and Tyler, 2005; Wilke et al., 2003), intermediate smoothing values (e.g. around 8 mm of FWHM) appear to be suitable for the size of lesions tested here. However, this parameter should be adapted to match the size of the expected lesions (due to the matched filter theory (Salmond et al., 2002a; White et al., 2001)), for instance by using low smoothing if the method is applied to identify tiny lesions (e.g. subcortical lesions (Vogels et al., 1995) or subtle GM malformations (Kassubek et al., 2002)). In addition, the sensitivity of the method also depends on the value of the parameter α during the quantification of the similarity measure D (i.e. see Eq. (2)). Basically, the parameter α controls how far a voxel should be from the mean of controls before it is considered an outlier. Here, it was set objectively to midway in the range of possible probability values (i.e. half the interval [0,1]). An extensive discussion of the influence of the parameter α can be found elsewhere (Seghier et al., 2007).
Critically, the comparison between the brain-damaged subjects and healthy subjects assume that both groups differ only according to the presence or absence of abnormal tissue. Thus, it is important to cancel or minimise all other potential sources of differences that might be caused by demographic variables, including age and gender. For instance, comparing an elderly subject to younger controls may lead to the detection of abnormal voxels caused by structural differences outside the real lesion (although atrophy detection might be relevant in other contexts; e.g. Convit et al., 2000). In addition, the specificity of the method also depends on the accuracy of the segmentation and the normalisation procedure. The normalisation procedure should accurately match the damaged brain to the controls to ensure good correspondence of healthy tissues in both groups. Several parameters may influence the quality of the normalisation procedure (e.g. Robbins et al., 2004; Salmond et al., 2002b; Shen et al., 2007; Wilke et al., 2003). Here we used an optimal normalisation procedure that has recently been shown to be more accurate in brain-damaged subjects than standard procedures (Crinion et al., 2007).
During the evaluation of our method, we assumed manual segmentation as the gold-standard method in order to define the “ground-truth” (true abnormal voxels) used for computing the Dice similarity index and evaluating ROC curves. However, this does not guarantee that misclassified voxels will not be included in the manually segmented lesions (which will lead to an increase of false positives/negative). For instance, Fiez et al. (2000) estimated the percentage of intra- and inter-operator errors during lesion identification in 10 subjects. In particular, they showed that, at the voxel level, the intra-operator error (i.e. percentage of nonoverlaping voxels between two lesion segmentations of the same subject and by the same operator) was on average 26% to 36% (for more details see Table 3 of Fiez et al. (2000)). Note also that the definition of “exact” lesion boundaries in a mono-spectral mode is difficult even with manual segmentation, because of partial volume effects in T1 images with limited spatial resolution (e.g. Guttmann et al., 1999; Links et al., 1998).
In this paper, we tested our method on a variety of lesions (size, location, texture). However, it is likely that other kinds of lesions might be challenging. Some lesion locations might be more difficult; for instance, posterior fossa lesions (e.g. infratentorial tumors) can be difficult to identify automatically (Gass et al., 2000). As the gyral anatomy of the cerebellum is more convoluted than that of the cerebrum, lesions in this region may give rise to disproportionate errors of spatial normalization. In this context, it might be useful to use more accurate cerebellar templates (for a similar rational see Diedrichsen, 2006). Other lesion locations or causes of abnormal signal intensity may also be problematic for our method. Periventricular lesions (lesions contiguous with ventricles, e.g. Zimmerman et al., 1986) can be classified as WM lesions but they are very difficult to distinguish from atrophy effects or CSF-partial voluming (Payne et al., 2002). In all these cases and as a general principle we recommend that all automated lesion profiles be checked by eye.
Finally, as shown above, identified lesions are coded as continuous values (the fuzzy degree of membership U in the interval [0,1]) providing a useful quantification of the degree of abnormality of each voxel. This is essential for methods that use continuous lesion values for generating lesion-deficit mappings (e.g. Tyler et al., 2005). On the other hand, for other mapping methods (e.g. Bates et al., 2003; Damasio et al., 2004; Dronkers et al., 2004; Karnath et al., 2004) or lesion overlap methods that use binary lesions, the binarisation process can be performed by applying a U threshold (typically 0.3) to the fuzzy lesions.
In summary, we have presented an automated method for lesion identification in mono-channel MRI that can be implemented easily within the SPM5 software package. With a modified segmentation procedure and fuzzy clustering, our approach was able to detect and delineate a variety of artificial and real lesions. From a clinical perspective, our method should help to compute the total volume of lesion, when this measure is appropriate, or to trace precisely the frontiers between the intact and damaged tissue that might be pertinent for surgical or diagnostic purposes.
Acknowledgments
This work was funded by the Wellcome Trust and the James S. MacDonnell Foundation (conducted as part of the NRG initiative). We thank Karl Friston and John Ashburner for their comments on an earlier version of the manuscript. We would like to thank Matthew Brett for providing us with the simulated lesions.
Footnotes
Supplementary data associated with this article can be found, in the online version, at doi:10.1016/j.neuroimage.2008.03.028.
Appendix A. Supplementary data
References
- Anbeek P., Vincken K.L., Van Osch M.J., Bisschops R.H., Van der Grond J. Automatic segmentation of different-sized white matter lesions by voxel probability estimation. Med. Image Anal. 2004;8:205–215. doi: 10.1016/j.media.2004.06.019. [DOI] [PubMed] [Google Scholar]
- Ashburner J., Friston K.J. Nonlinear spatial normalization using basis functions. Hum. Brain Mapp. 1999;7:254–266. doi: 10.1002/(SICI)1097-0193(1999)7:4<254::AID-HBM4>3.0.CO;2-G. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ashburner J., Friston K.J. Unified segmentation. NeuroImage. 2005;26:839–851. doi: 10.1016/j.neuroimage.2005.02.018. [DOI] [PubMed] [Google Scholar]
- Ashton E.A., Takahashi C., Berg M.J., Goodman A., Totterman S., Ekholm S. Accuracy and reproducibility of manual and semiautomated quantification of MS lesions by MRI. J. Magn. Reson. Imaging. 2003;17:300–308. doi: 10.1002/jmri.10258. [DOI] [PubMed] [Google Scholar]
- Bates E., Wilson S.M., Saygin A.P., Dick F., Sereno M.I., Knight R.T., Dronkers N.F. Voxel-based lesion-symptom mapping. Nat. Neurosci. 2003;6:448–450. doi: 10.1038/nn1050. [DOI] [PubMed] [Google Scholar]
- Bernasconi A. Advanced MRI analysis methods for detection of focal cortical dysplasia. Epileptic Disord. 2003;5:S81–S84. [PubMed] [Google Scholar]
- Brett M., Leff A.P., Rorden C., Ashburner J. Spatial normalization of brain images with focal lesions using cost function masking. NeuroImage. 2001;14:486–500. doi: 10.1006/nimg.2001.0845. [DOI] [PubMed] [Google Scholar]
- Capelle A.S., Colot O., Fernandez-Maloigne C. Evidential segmentation scheme of multi-echo MR images for the detection of brain tumors using neighborhood information. Inf. Fusion. 2004;5:203–216. [Google Scholar]
- Colliot O., Bernasconi N., Khalili N., Antel S.B., Naessens V., Bernasconi A. Individual voxel-based analysis of gray matter in focal cortical dysplasia. NeuroImage. 2006;29:162–171. doi: 10.1016/j.neuroimage.2005.07.021. [DOI] [PubMed] [Google Scholar]
- Colliot O., Mansi T., Bernasconi N., Naessens V., Klironomos D., Bernasconi A. Segmentation of focal cortical dysplasia lesions on MRI using level set evolution. NeuroImage. 2006;32:1621–1630. doi: 10.1016/j.neuroimage.2006.04.225. [DOI] [PubMed] [Google Scholar]
- Convit A., de Asis J., de Leon M.J., Tarshish C.Y., De Santi S., Rusinek H. Atrophy of the medial occipitotemporal, inferior, and middle temporal gyri in non-demented elderly predict decline to Alzheimer's disease. Neurobiol. Aging. 2000;21:19–26. doi: 10.1016/s0197-4580(99)00107-4. [DOI] [PubMed] [Google Scholar]
- Crinion J., Ashburner J., Leff A., Brett M., Price C.J., Friston K.J. Spatial normalization of lesioned brains: performance evaluation and impact on fMRI analyses. NeuroImage. 2007;37:866–875. doi: 10.1016/j.neuroimage.2007.04.065. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Damasio H., Tranel D., Grabowski T.J., Adolphs R., Damasio A. Neural systems behind word and concept retrieval. Cognition. 2004;92:145–177. doi: 10.1016/j.cognition.2002.07.001. [DOI] [PubMed] [Google Scholar]
- Datta S., Sajja B.R., He R., Wolinsky J.S., Gupta R.K., Narayana P.A. Segmentation and quantification of black holes in multiple sclerosis. NeuroImage. 2006;29:467–474. doi: 10.1016/j.neuroimage.2005.07.042. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Dice L.R. Measures of the amount of ecological association between species. Ecology. 1945;26:297–302. [Google Scholar]
- Diedrichsen J. A spatially unbiased atlas template of the human cerebellum. NeuroImage. 2006;33:127–138. doi: 10.1016/j.neuroimage.2006.05.056. [DOI] [PubMed] [Google Scholar]
- Dronkers N.F., Wilkins D.P., Van Valin R.D.J., Redfern B.B., Jaeger J.J. Lesion analysis of the brain areas involved in language comprehension. Cognition. 2004;92:145–177. doi: 10.1016/j.cognition.2003.11.002. [DOI] [PubMed] [Google Scholar]
- Fiez J.A., Damasio H., Grabowski T.J. Lesion segmentation and manual warping to a reference brain: intra- and interobserver reliability. Hum. Brain Mapp. 2000;9:192–211. doi: 10.1002/(SICI)1097-0193(200004)9:4<192::AID-HBM2>3.0.CO;2-Y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Filippi M., Horsfield M.A., Bressi S., Martinelli V., Baratti C., Reganati P., Campi A., Miller D.H., Comi G. Intra- and inter-observer agreement of brain MRI lesion volume measurements in multiple sclerosis. A comparison of techniques. Brain. 1995;118:1593–1600. doi: 10.1093/brain/118.6.1593. [DOI] [PubMed] [Google Scholar]
- Fletcher-Heath L.M., Hall L.O., Goldgof D.B., Murtaqh F.R. Automatic segmentation of non-enhancing brain tumors in magnetic resonance images. Artif. Intell. Med. 2001;21:43–63. doi: 10.1016/s0933-3657(00)00073-7. [DOI] [PubMed] [Google Scholar]
- Frank R.J., Damasio H., Grabowski T.J. Brainvox: an interactive, multimodal visualization and analysis system for neuroanatomical imaging. NeuroImage. 1997;5:13–30. doi: 10.1006/nimg.1996.0250. [DOI] [PubMed] [Google Scholar]
- Gass A., Filippi M., Grossman R.I. The contribution of MRI in the differential diagnosis of posterior fossa damage. J. Neurol. Sci. 2000;172:S43–S49. doi: 10.1016/s0022-510x(99)00278-6. [DOI] [PubMed] [Google Scholar]
- Gitelman D.R., Ashburner J., Friston K.J., Tyler L.K., Price C.J. Voxel-based morphometry of herpes simplex encephalitis. NeuroImage. 2001;13:623–631. doi: 10.1006/nimg.2000.0734. [DOI] [PubMed] [Google Scholar]
- Guttmann C.R.G., Kikinis R., Anderson M.C., Jakab M., Warfield S.K., Killiany R.J., Weiner H.L., Jolesz F.A. Quantitative follow-up of patients with multiple sclerosis using MRI: Reproducibility. J. Magn. Reson. Imaging. 1999;9:509–518. doi: 10.1002/(sici)1522-2586(199904)9:4<509::aid-jmri2>3.0.co;2-s. [DOI] [PubMed] [Google Scholar]
- Ho S., Bullitt E., Gerig G. Level set evolution with region competition: automatic 3-D segmentation of brain tumours. Proc 16th Intern Conf Pattern Recogn, IEEE Computer Society. 2002. pp. 532–535. [Google Scholar]
- Hojjatoleslami S.A., Kruggel F. Segmentation of large brain lesions. IEEE Trans. Med. Imag. 2001;20:666–669. doi: 10.1109/42.932750. [DOI] [PubMed] [Google Scholar]
- Hou Z. A review on MR image intensity inhomogeneity correction. Int. J. Biomed. Imag. 2006;2006:1–11. doi: 10.1155/IJBI/2006/49515. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ibrahim A.M. Prentice Hall; Upper Saddle River, NJ: 1997. Introduction to Applied Fuzzy Electronics. [Google Scholar]
- Jack C.R., O'Brien P.C., Rettman D.W., Shiung M.M., Xu Y., Muthupillai R., Manduca A., Avula R., Erickson B.J. FLAIR histogram segmentation for measurement of leukoaraiosis volume. J. Magn. Reson. Imaging. 2001;14:668–676. doi: 10.1002/jmri.10011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kabir Y., Dojat M., Scherrer B., Forbes F., Garbay C. Multimodal MRI segmentation of ischemic stroke lesions. 29th Ann Intern Conf IEEE Eng Med Biol Soc EMBC, Lyon France. 2007. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Karnath H.O., Fruhmann-Berger M., Kuker W., Rorden C. The anatomy of spatial neglect based on voxelwise statistical analysis: a study of 140 patients. Cereb. Cortex. 2004;14:1164–1172. doi: 10.1093/cercor/bhh076. [DOI] [PubMed] [Google Scholar]
- Kassubek J., Huppertz H.J., Spreer J., Schulze-Bonhage A. Detection and localization of focal cortical dysplasia by voxel-based 3-D MRI analysis. Epilepsia. 2002;43:596–602. doi: 10.1046/j.1528-1157.2002.41401.x. [DOI] [PubMed] [Google Scholar]
- Lau P.Y., Ozawa S. A simple method for detecting tumor in T2-weighted MRI brain images: an image-based analysis. IEICE Trans. Inf. Syst. 2006;E89-D:1270–1279. [Google Scholar]
- Links J.M., Beach L.S., Subramana B., Rubin M.A., Hennessey J.G., Reiss A.L. Edge complexity and partial volume effects. J. Comput. Assist. Tomogr. 1998;22:450–458. doi: 10.1097/00004728-199805000-00019. [DOI] [PubMed] [Google Scholar]
- Liu J.G., Udupa J.K., Hackney D., Moonis G. Brain tumor segmentation in MRI by using the fuzzy connectedness method. Proc. SPIE. 2001;4322:1455–1465. [Google Scholar]
- Makale M., Solomon J., Patronas N.J., Danek A., Butman J.A., Grafman J. Quantification of brain lesions using interactive automated software. Behav. Res. Meth. Instrum. Comput. 2002;34:6–18. doi: 10.3758/bf03195419. [DOI] [PubMed] [Google Scholar]
- Mehta S., Grabowski T.J., Trivedi Y., Damasio H. Evaluation of voxel-based morphometry for focal lesion detection in individuals. NeuroImage. 2003;20:1438–1454. doi: 10.1016/s1053-8119(03)00377-x. [DOI] [PubMed] [Google Scholar]
- Metz C.E. Basic principles of ROC analysis. Semin. Nucl. Med. 1978;8:283–298. doi: 10.1016/s0001-2998(78)80014-2. [DOI] [PubMed] [Google Scholar]
- Moon N., Bullitt E., Van Leemput K., Gerig G. Automatic brain and tumor segmentation. In: Dohi T., Kikinis R., editors. Medical Image Computing and Computer-Assisted Intervention MICCAI. 2002. pp. 372–379. [Google Scholar]
- Payne M.E., Fetzer D.L., MacFall J.R., Provenzale J.M., Byrum C.E., Krishnan K.R.R. Development of a semi-automated method for quantification of MRI gray and white matter lesions in geriatric subjects. Psychiatry Res. Neuroimaging. 2002;115:63–77. doi: 10.1016/s0925-4927(02)00009-4. [DOI] [PubMed] [Google Scholar]
- Prastawa M., Bullitt E., Moon N., Van Leemput K., Gerig G. Automatic brain tumor segmentation by subject specific modification of atlas priors. Acad. Radiol. 2003;10:1341–1348. doi: 10.1016/s1076-6332(03)00506-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Prastawa M., Bullitt E., Ho S., Gerig G. A brain tumor segmentation framework based on outlier detection. Med. Image Anal. 2004;8:275–283. doi: 10.1016/j.media.2004.06.007. [DOI] [PubMed] [Google Scholar]
- Robbins S., Evans A.C., Collins D.L., Whitesides S. Tuning and comparing spatial normalization methods. Med. Image Anal. 2004;8:311–323. doi: 10.1016/j.media.2004.06.009. [DOI] [PubMed] [Google Scholar]
- Rorden C., Brett M. Stereotaxic display of brain lesions. Behav. Neurol. 2000;12:191–200. doi: 10.1155/2000/421719. [DOI] [PubMed] [Google Scholar]
- Ruan S., Lebonvallet S., Merabet A., Constans J.M. Tumor segmentation from a multispectral MRI images by using support vector machine classification. 4th IEEE Int. Symp. Biomed. Imaging. 2007:1236–1239. [Google Scholar]
- Sajja B.R., Datta S., He R., Mehta M., Gupta R.K., Wolinsky J.S., Narayana P.A. Unified approach for multiple sclerosis lesion segmentation on brain MRI. Ann. Biomed. Eng. 2006;34:142–151. doi: 10.1007/s10439-005-9009-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Salmond C.H., Ashburner J., Vargha-Khadem F., Connelly A., Gadian D.G., Friston K.J. Distributional assumptions in voxel-based morphometry. NeuroImage. 2002;17:1027–1030. [PubMed] [Google Scholar]
- Salmond C.H., Ashburner J., Vargha-Khadem F., Connelly A., Gadian D.G., Friston K.J. The precision of anatomical normalization in the medial temporal lobe using spatial basis functions. NeuroImage. 2002;17:507–512. doi: 10.1006/nimg.2002.1191. [DOI] [PubMed] [Google Scholar]
- Seghier M.L., Friston K.J., Price C.J. Detecting subject-specific activations using fuzzy clustering. NeuroImage. 2007;36:594–605. doi: 10.1016/j.neuroimage.2007.03.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Shen S., Szameitat A.J., Sterr A. VBM lesion detection depends on the normalization template: a study using simulated atrophy. Magn. Reson. Imaging. 2007;25:1385–1396. doi: 10.1016/j.mri.2007.03.025. [DOI] [PubMed] [Google Scholar]
- Solomon J., Raymont V., Braun A., Butman J.A., Grafman J. User-friendly software for the analysis of brain lesions (ABLe) Magn. Reson. Imaging. 2007;86:245–254. doi: 10.1016/j.cmpb.2007.02.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Soltanian-Zadeh H., Peck D.J., Windham J.P., Mikkelsen T. Brain tumor segmentation and characterization by pattern analysis of multispectral NMR images. NMR Biomed. 1998;11:201–208. doi: 10.1002/(sici)1099-1492(199806/08)11:4/5<201::aid-nbm508>3.0.co;2-6. [DOI] [PubMed] [Google Scholar]
- Stamatakis E.A., Tyler L.K. Identifying lesions on structural brain images–validation of the method and application to neuropsychological patients. Brain Lang. 2005;94:167–177. doi: 10.1016/j.bandl.2004.12.010. [DOI] [PubMed] [Google Scholar]
- Tyler L.K., Marslen-Wilson W., Stamatakis E.A. Dissociating neuro-cognitive component processes: voxel-based correlational methodology. Neuropsychologia. 2005;43:771–778. doi: 10.1016/j.neuropsychologia.2004.07.020. [DOI] [PubMed] [Google Scholar]
- Van Leemput K., Maes F., Vandermeulen D., Colchester A., Suetens P. Automated segmentation of multiple sclerosis lesions by model outlier detection. IEEE Trans. Med. Imaging. 2001;20:677–688. doi: 10.1109/42.938237. [DOI] [PubMed] [Google Scholar]
- Vogels O.J., Zijlmans J.C., van't Hof M.A., Thijssen H.O., Horstink M.W. MR volume estimation of subcortical brain lesions and ventricular cerebrospinal fluid: a simple and accurate stereologic method. Am. J. Neuroradiol. 1995;16:1441–1445. [PMC free article] [PubMed] [Google Scholar]
- White T., O'Leary D., Magnotta V., Arndt S., Flaum M., Andreasen N.C. Anatomic and functional variability: the effects of filter size in group fMRI data analysis. NeuroImage. 2001;13:577–588. doi: 10.1006/nimg.2000.0716. [DOI] [PubMed] [Google Scholar]
- Wilke M., Kassubek J., Ziyeh S., Schulze-Bonhage A., Huppertz H.J. Automated detection of gray matter malformations using optimized voxel-based morphometry: a systematic approach. NeuroImage. 2003;20:330–343. doi: 10.1016/s1053-8119(03)00296-9. [DOI] [PubMed] [Google Scholar]
- Woermann F.G., Free S.L., JKoepp M.J., Ashburner J., Duncan J.S. Voxel-by-voxel comparison of automatically segmented cerebral gray matter—a rater-independent comparison of structural MRI in patients with epilepsy. NeuroImage. 1999;10:373–384. doi: 10.1006/nimg.1999.0481. [DOI] [PubMed] [Google Scholar]
- Wu Y., Warfield S.K., Tan I.L., Wells W.M., Meier D.S., van Schijndel R.A., Barkhof F., Guttmann C.R. Automated segmentation of multiple sclerosis lesion subtypes with multichannel MRI. NeuroImage. 2006;32:1205–1215. doi: 10.1016/j.neuroimage.2006.04.211. [DOI] [PubMed] [Google Scholar]
- Xie K., Yang J., Zhang Z.G., Zhu Y.M. Semi-automated brain tumor and edema segmentation using MRI. Eur. J. Radiol. 2005;56:12–19. doi: 10.1016/j.ejrad.2005.03.028. [DOI] [PubMed] [Google Scholar]
- Zhou J., Chan K., Chong H.V., Krishnan S. Extraction of brain tumor from MR images using one-class support vector machine. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2005;6:6411–6414. doi: 10.1109/IEMBS.2005.1615965. [DOI] [PubMed] [Google Scholar]
- Zimmerman R.D., Fleming C.A., Lee B.C.P., Saint-Louis L.A., Deck M.D.F. Periventricular hyperintensity as seen by magnetic resonance: prevalence and significance. Am. J. Neuroradiol. 1986;7:13–20. doi: 10.2214/ajr.146.3.443. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.