Abstract
Parkinson’s disease is caused due to the progressive loss of dopaminergic neurons in the substantia nigra pars compacta (SNc). Presently, with the exponential growth of the aging population across the world the number of people being affected by the disease is also increasing and it imposes a huge economic burden on the governments. However, to date, no therapy or treatment has been found that can completely eradicate the disease. Therefore, early detection of Parkinson’s disease is very important so that the progressive loss of dopaminergic neurons can be controlled to provide the patients with a better life. In this study, 3T T1-MRI scans were collected from 906 subjects, out of which, 203 are control subjects, 66 are prodromal subjects and 637 are Parkinson’s disease patients. To analyze the MRI scans for the detection of neurodegeneration and Parkinson’s disease, eight subcortical structures were segmented from the acquired MRI scans using atlas based segmentation. Further, on the extracted eight subcortical structures, feature extraction was performed to extract textural, morphological and statistical features, respectively. After the feature extraction process, an exhaustive set of 107 features were generated for each MRI scan. Therefore, a two-level feature extraction process was implemented for finding the best possible feature set for the detection of Parkinson’s disease. The two-level feature extraction procedure leveraged correlation analysis and recursive feature elimination, which at the end provided us with 20 best performing features out of the extracted 107 features. Further, all the features were trained using machine learning algorithms and a comparative analysis was performed between four different machine learning algorithms based on the selected performance metrics. And at the end, it was observed that artificial neural network (multi-layer perceptron) performed the best by providing an overall accuracy of 95.3%, overall recall of 95.41%, overall precision of 97.28% and f1-score of 94%, respectively.
Keywords: Parkinson’s disease, neurodegeneration, MRI, 3D, texture, morphology
1. Introduction
Parkinson’s disease (PD) is the second most common neurological disorder among elderly people with ages above 65 years. This disease affects the brain cells, which in turn creates cognitive disorders as well as movement disorders in healthy human beings. As the disease is progressive in nature, early detection and monitoring can save a huge amount of healthcare costs. As the population of old age people is increasing and also in the future, it will increase exponentially, therefore it is necessary to find suitable methods for the detection of neurodegenerative diseases at a very early stage [1,2,3]. One of the widely used diagnostic tools, known as Magnetic Resonance Imaging (MRI), has been known for providing anatomical details of brain tissues that could be used for early detection of PD. Although MRI provides a lot of important details, it is really difficult for the human eye to detect the intrinsic details and the heterogeneous properties of certain tissues of the region of interests (ROI’s) [4]. With the advancement of technology, computer-aided diagnostic tools have been considered very effective for the detection and diagnosis of diseases as it provides morphological details about different tissues of the ROIs.
The researchers in the past found that texture analysis of tissue and cellular images can be used for the detection and diagnosis of multiple diseases. Its application is huge starting from segmentation of the identified anatomical structures at the ROIs to the classification of tissues. The quantification of grey-level patterns and pixel inter-relationship within an image, which can measure the heterogeneities in the tissues can also be performed using texture analysis using a variety of techniques. It has been found that the textual patterns are different for different image areas, which are sometimes unnoticeable to the human eyes [5]. In the past researchers have used texture analysis for segmentation and classifications of lesions and tissues which are widely used for diagnosis of critical diseases. In recent years the texture analysis has been widely used in neurological applications [6]. Some of the applications of texture analysis in neurological disorders include differentiation between different types of tumors, classification of diseases like Alzheimer’s, Friedreich’s ataxia, etc. [7,8,9,10].
Traditionally 2D textural analysis is most commonly used for any application, but in the recent years 3D textural analysis also received a lot of attention because 3D analysis provides more discriminative information compared to 2D analysis. In 2D texture analysis, the individual pixel of interest (POI) has eight neighbor pixels that can be analyzed in four directions that are independent of each other. Whereas in 3D texture analysis, the individual voxel of interest has 26 neighbor voxels that can be analyzed in the 13 directions that are independent of each other [11]. In recent years machine learning and deep learning techniques have been widely used for medical applications especially to improve the clinical practice [12]. Machine learning and deep learning techniques are widely used for improving the efficiency in the radiological practices and assisting the doctors to take decisions in a faster way [13]. Therefore, the proposed study puts forward a 3D Texture, morphological and statistical analysis of the Voxel of Interests for the detection of Parkinson’s disease using machine learning algorithms.
The structure of the paper is organized as follows: Section 2 describes the related work of the study and the past works that have an alignment with the present study. Section 3 puts forward the specification of the data that was collected from the Parkinson’s Progression Markers Initiative (PPMI) database and the atlases that were used for the preprocessing of the acquired MRI scans followed by atlas-based segmentation of eight subcortical structures of the basal ganglia which are prone to neuron degeneration. Section 4 describes the methodology of the complete work and also extensively discusses the feature extraction, feature engineering, and feature selection process. Moreover, Section 4 also puts forward the hypothesis for the development of machine learning algorithms and also gives a complete overview of the learning process and comparative analysis. Section 5, plots the results of the complete study and Section 6 discusses the overall implication and usefulness of the study. Finally, the paper is concluded in Section 7.
2. Related Work
In the past, texture analysis has been applied to medical imaging and has already shown its potential as a biomarker for discriminating diseases based on healthy tissue and damaged tissues in the ROI. Feng et al. proposed a method that used texture analysis and shapes analysis to model the hippocampus region based on the structural MRI to distinguish mild cognitive impairment (MCI) from Alzheimer’s disease. They have found that their model is performing well by comparing with the state of art models [14]. Martinez-Murcia et al. proposed a method that used texture analysis to find out the structural changes occurred in the different regions of the brain when a person is suffered from Alzheimer’s disease (AD).
In this research, they have focused only on cortical and subcortical parts of the brain and they found that this method could able to provide accuracy up to 81.3% to detect the changes in AD [15]. Sikio et al. proposed a method using texture analysis to detect the structural changes in the brain in PD patients. They have monitored the patient for two years and compared the structural changes with the MRI baseline i.e., taken at the beginning of diagnosis to the MRI after 2 years. They have observed that texture analysis can discriminate against the changes that occurred in the brain and it was significantly related to clinical scores with respect to the severity of the diseases [16]. Betrouni et al. proposed a method that used textural analysis for discrimination PD patients from healthy controls. They have considered six regions of the brain and extracted first-order and second-order features as a part of the textural analysis and their correlation related to cognitive function. They found that these textual features could able to distinguish PD and also help in the diagnosis of PD [17]. Li et al. performed an extensive study regarding the 3D texture analysis of substantia nigra of Parkinson’s disease patients on quantitative susceptibility maps (QSM) and R2* maps. The primary objective of the study was to discriminate PD patients from health control (HC). Therefore, the authors obtained the QSM and R2* maps from the 3T MRI scans from 28 PD and 28 HC using 3D multi-echo gradient-echo sequence. Further, first and second order textural features were obtained from the QSM and R2* maps for discriminating the PD and HC using two tailed t-test. And it was found that first and second order QSM textual features accurately distinguished PD from HC [18].
Zhang et al. proposed a method that used 3D textural analysis for distinguishing AD patients and healthy normal controls by extracting features from the entorhinal cortex and hippocampus regions. They found that 3D features could able to find the difference in the texture of AD patients and normal patients and this proposed method could be helpful for the diagnosis of AD [19]. Lee et al. proposed a method that could predict the progression from the stage mild cognitive impairment (MCI) to AD at the early stage based on the features extracted from the hippocampus, precuneus, and posterior cingulate cortex regions. It was found that the extracted textures from the mentioned three regions could able to predict MCI to AD at an early stage [20]. Li et al. proposed a method that can distinguish AD, MCI, and normal control based on the 3D textural features obtained from the hippocampus region. They found that the pathological changes that occurred in the hippocampus region of the patients could be analyzed using 3D textural analysis and this method could help to diagnose the patients at the early stage of AD [21].
Xiao et al. proposed a method that can classify AD from McEwan normal controls using a multi-feature technique and fused it together by taking the 2D and 3D information of the brains. They have used feature selection techniques to extract optimal feature combinations and that produces better classification performances. They found that the proposed method could help to identify different classes without apparent symptoms [22]. Maani et al. proposed a texture analysis method that used the extracted features on a voxel by voxel basis for the classification of AD and control groups. It was found that the artificial effects of AD and the control group have been detected with high accuracy using this proposed method. The accuracy of the result provided enough support to extend it for other diseases such as cerebral pathology in neurological diseases [23]. Ta et al. mentioned that 3D texture analysis has the potential for the detection of cerebral degeneration which is not easily noticeable for the naked eye. They have found that 3D texture analysis has shown potential and enough reliability that it can be used for longitudinal studies [24].
The above-mentioned literature confirms the success of the analysis of MRI scans for the detection of Neurodegenerative diseases such as Alzheimer’s and Parkinson’s. Moreover, texture, morphological and statistical analysis of ROI for Alzheimer’s disease have been pathbreaking. Therefore the findings of the above-described studies motivated us to design the proposed study for the analysis of the textural, morphological and statistical features of the eight subcortical structures prone to neuron degeneration and responsible for Parkinson’s disease.
3. Data Collection and Preprocessing
3.1. Data Collection
The data for the study was obtained from the Parkinson’s Progression Markers Initiative (PPMI) database (www.ppmi-info.org/data). PPMI is a landmark, international and multicenter study to determine Parkinson’s progressions biomarkers. All the MRI scans that were selected for the study were performed at the baseline visit. All the scans that were considered for the study were acquired from a similar type of scanner (SIEMENS, Munich, Germany) and also all the MRI scans were based on Magnetization Prepared—Rapid Gradient Echo (MP-RAGE) sequence. The scans were acquired in a time range of 20–30 min and the field of view (FOV) of all the images included vertex, cerebellum, and pons. Moreover, all the scans were further chosen using some specific criteria as mentioned in Table 1.
Table 1.
Imaging Protocol | Values |
---|---|
Modality | MRI |
Research Group | Control, Prodromal and PD |
Visit | Baseline |
Acquisition Plane | Sagittal |
Acquisition Type | 3D |
Field Strength | 3.0 Tesla |
Flip Angle | 9 Degree |
Scanner Manufacturing | Siemens (MPRAGE) |
Pixel Spacing | 0.9 mm–1.5 mm (X &Y) |
Slice Thickness | 1.0 mm |
Weighting | T1 |
After applying the filters based on the imaging protocol mentioned in Table 1, a total of 906 MRI scans where chosen from the baseline visit of 906 patients. Out of the 906 patients, 306 were female and 600 were male. The age of all the enrolled subjects was 62.64 ± 9.944. Moreover, the scans were acquired from primarily three groups, namely control, prodromal and Parkinson’s disease. The distribution of all the scans distributed into the research groups as 203 control, 66 prodromal and 637 Parkinson’s disease. For considering a subject to a particular research group certain eligibility criterion was considered which are mentioned in Table 2.
Table 2.
Research Group | Criteria |
---|---|
Parkinson’s Disease |
|
Control Subjects |
|
Prodromal |
|
Figure 1 below plots out the sample MRI Image scans belonging to each research group which was acquired from the PPMI database and Table 3 describes the specifications and the metadata of the acquired MRI scans.
Table 3.
Image Parameters | Values |
---|---|
Dimensions | 256 × 256 × 170–200 pixels |
Interslice Gap | 0.0 mm |
Slice Thickness | 1.0 mm |
Spacing | 1.0 × 1.0 × 1.0 mm |
Plane | Sagittal |
3.2. Data Preprocessing
The dataset that was acquired from the PPMI database was collected from multiple study centers across the globe and the scans from different centers had multiple temporal differences. Therefore to maintain a constant spatial tendency between all the scans and also to bring the scans to the same space such as Montreal Neurological Institute (MNI) or Individual Brain Atlases using Statistical Parametric Mapping (IBASPM) [25], an image registration procedure was performed. Image registration is a process that mutates upon a fixed image to find the correct alignment parameters so that an unknown or unseen image can be aligned similarly to the fixed image. In the simplest form, it can be stated that it is a process of aligning two images where one acts as the target image and the other acts as a source image, and the source image is transformed to match the target image. In the present context, the acquired image from the PPMI database is considered as the source image and the target image is an atlas such as MNI or IBASPM.
The registration of the acquired scans from the PPMI database was performed using the MNIPD25-T1MPRAGE-1 mm atlas developed by Xiao et al. [26,27,28]. Table 4 below describes the specification of the atlas that has been used for the registration. For the registration of the scans, ANTsPy [29] was leveraged which is used for extracting information from complex imaging datasets and is considered to be one of the most effective tools for performing preprocessing on MRI, fMRI, and SPECT scans. The process of registration leveraged a symmetric normalization which performed an affine and deformable transformation on the acquired MRI scans. Figure 2 below shows the scan of a particular image before and after the registration respectively.
Table 4.
Image Parameters | Values |
---|---|
Dimensions | 193 × 229 × 193 pixels |
Interslice Gap | 0.0 mm |
Slice Thickness | 1.0 mm |
Spacing | 1.0 × 1.0 × 1.0 mm |
Plane | Sagittal |
4. Materials and Methods
The primary proposition of the complete study plots the method of detecting and classifying MRI scans of subjects as control (healthy subjects), Prodromal (stage where the patients do not fulfill the diagnostic criteria for Parkinson’s disease such as bradykinesia or display any motor symptoms but demonstrate signs and symptoms of developing motor symptoms in future) and Parkinson’s disease using textural features. Figure 3 plotted below shows the complete methodology of the performed study and shows the process of leveraging textural features from MRI scans to classify the images as either control, prodromal or Parkinson’s disease.
In the above figure, the complete process for the 3D texture analysis of eight subcortical ROI’s of an MRI scan for the detection of Parkinson’s disease is been demonstrated. The complete process is divided into seven different stages. The first two stages of the process, that is MRI acquisition from the PPMI Database and data preprocessing, registration and transformation, have been described thoroughly in Section 3. The next four stages of the process that are atlas-based segmentation, ROI- based feature engineering, feature selection, machine learning classifier development and performance evaluation of the classifier are described in the following sections.
4.1. Atlas Based ROI Segmentation
The study focused on deriving textural features, morphological features and statistical features from the MRI scan for the detection of Parkinson’s disease. The detection of Parkinson’s disease has been studied in previous works [30,31,32,33] where it is shown that anatomical changes occur in the structures of basal ganglia and its adjacent structures due to neurodegeneration which is the primary cause of Parkinson’s disease. The basal ganglia constitute a set of structures that are found at the innermost part of the cerebral hemisphere. The structures that constitute the basal ganglia are the caudate-putamen, global pallidum, substantia nigra and the subthalamic nucleus. Therefore, for fetching the ROIs from the MRI images that are responsible for Parkinson’s disease, atlas-based ROI segmentation was performed on the MRI images acquired in the study. The atlas that was selected for the ROI-based segmentation was MNIPD25-Subcortical-1 mm [26,27,28]. The atlas was developed by manually segmenting eight subcortical structures, namely, caudate nucleus, putamen, globus pallidus internus and externus (GPi & GPe), thalamus, STN, substantia nigra (SN), and red nucleus (RN). Figure 4 below depicts the 3D structure of the eight subcortical structures of the basal ganglia and its adjacent regions. Figure 5 presents the ROIs on the MNI space by plotting it on the MNI-ICBM-152 template [34,35,36] and on a sample MRI scan acquired from the PPMI database.
The labels of the ROIs of the MNIPD25-Subcortical-1 mm atlas were used for segmenting the acquired MRI scans. The labels with the definition of each label are further described in Table 5. For the segmentation procedure, the voxel indices from the MNIPD25-Subcortical-1 mm atlas were calculated by maintaining the spacing, orientation and slice thickness of the slices. Further, the same indices from the registered and transformed acquired MRI were extracted by similarly maintaining the spacing, orientation and slice thickness of the slice. By following this particular method all the 16 volumetric ROI’s from eight subcortical structures were extracted. Figure 6 below shows a scan which only contains the voxel of interest after performing the segmentation.
Table 5.
Label | Structure |
---|---|
1 | Left red nucleus |
3 | Left substantia nigra |
5 | Left subthalamic nucleus |
7 | Left caudate |
9 | Left putamen |
11 | Left globus pallidus external |
13 | Left globus pallidus internal |
15 | Left thalamus |
2 | Right red nucleus |
4 | Right Substantia nigra |
6 | Right subthalamic nucleus |
8 | Right caudate |
10 | Right putamen |
12 | Right globus pallidus external |
14 | Right globus pallidus internal |
16 | Right thalamus |
4.2. ROI Based Feature Engineering
The feature engineering for the study was performed on the segmented 3D voxels from the MRI scans acquired from the PPMI database. The features that were extracted from the segmented 3D voxels were textural, morphological and statistical features [37]. In total 107 features were extracted from the segmented voxels. For the calculation of features, initially, all the 107 features were calculated for each of the 16 subcortical structures/labels mentioned in Table 5. Further, the feature values of a particular feature from all the 16 subcortical structures were aggregated using statistical techniques such a mean, mode and sum to create one feature value for all 16 subcortical structures for each image. In this study, it can be observed that an exhaustive set of features has been computed as compared to the previous studies because we also aim to identify the best features in terms of MRI scans for the prediction of Parkinson’s disease. Table 6 below provides the details of the types of features that were calculated for the feature engineering.
Table 6.
Feature Type | Number of Features |
---|---|
First Order Statistical Features | 17 Features |
Shape-Based (2D) | 10 Features |
Shape-Based (3D) | 10 Features |
Gray Level Cooccurrence Matrix | 24 Features |
Gray Level Run Length Matrix | 12 Features |
Gray Level Size Zone Matrix | 12 Features |
Neighbouring Gray Tone Difference Matrix | 12 Features |
Gray Level Dependence Matrix | 10 Features |
Exhaustive set of Features (Total) | 107 Features |
4.3. Feature Selection and Machine Learning Classifier Development
In this study, an exhaustive list of features was calculated based on the texture, morphology, and statistics of the 3D voxels of the segmented subcortical structures, but the wide list of features contained a lot of correlation. Moreover, as mentioned previously that choosing the appropriate feature set is also a proposition of the study. Therefore for choosing the right set of features for the machine learning model, a two-level feature selection method was used by leveraging a filter method (Pearson’s correlation coefficient) and a recursive feature elimination method.
After performing correlation analysis on the features, 42 features were rejected based on a Pearson’s correlation coefficient of more than 90%. Further, the remaining 65 features were extracted from the exhaustive feature set for performing the second level feature selection using the recursive feature elimination [39] method. Recursive feature elimination is a greedy optimization algorithm which aims to find the best performing feature subset. It repeatedly creates baseline models and keeps aside the best or the worst performing feature at each iteration until all the features are exhausted. It then ranks the features based on the order of their elimination. Therefore, for our study, a logistic regression model was used for creating the baseline model and for initiating the recursive feature elimination process. Moreover, the recursive feature elimination was also initiated with an argument of fetching 20 best features based on optimum performance of the baseline model in the detection of prodromal and Parkinson’s disease cases, respectively. Moreover, a recursion was also for selecting 10, 30 and 40 best features, respectively, but it was found that selecting 20 best features using recursive feature elimination gave the best result. Table 7 above provides information about the feature that was derived by running the recursive feature elimination and has been arranged in descending order of feature importance.
Table 7.
Feature Name | Description | Equation |
---|---|---|
Skewness | It measures the asymmetry of the distribution of values about the Mean value. | Skew = |
Entropy | It measures the uncertainty or randomness in the image values. | Entropy = |
Total Energy | It is the measure of the magnitude of voxel values in an image. | Total Energy = |
Interquartile Range | It measures the percentile of image data present between 25th percent to 75th percent. | IQR = |
Mesh Volume [38] | It measures the Volume of ROI. | |
Surface Area | It measures the extrinsic surface are of the ROI | |
Major Axis Length | It measures the largest axis length of the ROI enclosing ellipsoid using the largest principal component. | Major axis = |
Minor Axis Length | It measures the second- largest axis length of the ROI enclosing ellipsoid using the largest principal component. | Minor axis = |
Autocorrelation | It measures the magnitude of the fineness and coarseness of texture. | Auto_corr = |
Cluster Prominence | It measures the skewness and asymmetry of the Gray Level Co-occurrence Matrix. | CP = |
Difference Entropy | It is a measure of the randomness/variability in neighborhood intensity value differences. | DE = |
Inverse Difference Moment | IDM measures the local homogeneity of an image. | IDM = |
Small Area High Gray Level Emphasis (SAHGLE) | It measures the proportion in the image of the joint distribution of smaller size zones with higher gray level values | SAHGLE = |
Gray Level Non-Uniformity [16] | It measures the similarity of gray level intensity values in the images, where a lower GLN value correlates with a greater similarity in intensity values | GLN = |
Gray Level Variance | It measures the variance in gray level intensity for the runs | GLV = |
Run Entropy | It measures the randomness in the distribution of run length and gray levels. | RE = |
Long Run High Gray Level Emphasis (LRHGLE) | It measures the joint distribution of long-run lengths with higher gray-level values. | LRHGLRE = |
Coarseness | It measures the average difference between the center voxel and its neighborhood and is an indication of the spatial rate of change | Coarseness = |
Small Dependence Emphasis | It measures the small dependencies, with a greater value indicative of smaller dependence and less homogeneous textures. | SDE = |
Dependence Non-Uniformity | It measures the similarity of dependence throughout the image, with a lower value indicating more homogeneity among dependencies in the image. | DN = |
As the features have been generated and the optimum number of features have been selected from the exhaustive feature set, therefore now the primary motive of the study is the development of the machine learning models for the classification of the MRI scans into three classes namely, control, prodromal, and Parkinson’s disease. The development of machine learning models are very essential for the development of such an automated system for the classification of textural, morphological and statistical features of brain MRI scans for the detection of Parkinson’s disease. Therefore, for the development of the machine learning model, four different machine learning algorithms were used for classification purposes. Also, the usage of four machine learning algorithms for the classification purpose is only required for performing a comparative analysis between the performances of the classifiers. Moreover, for the development of machine learning algorithms, the first this that needs to be determined is the hypothesis of the problem that needs to be solved, so the primary hypothesis that was devised for developing of the machine learning algorithms are as follows:
-
(1)
The recall of Parkinson’s disease class must be 100% and there should not be any mispredictions of the samples belonging to Parkinson’s disease class to any of the other two classes.
-
(2)
For the prodromal class, there must not be any mispredictions of samples belonging to the Prodromal class to the Control class.
-
(3)
The recall of the control class must be more than 85%.
Therefore based upon the above-mentioned hypothesis, the machine learning models were developed. For checking the performance of the machine learning models five different classification performance metrics were leveraged namely, accuracy, recall, precision, f1 score, and confusion matrix. Also, for checking the generalizability of the developed machine learning model 5 split cross-validation was performed. The details about the performance of the cross-validation are described properly in the Results section. Table 8 below provides the information regarding the machine learning algorithms used and also the hyperparameters that was used for the development of the machine learning algorithms.
Table 8.
Classifier | Specification |
---|---|
Artificial Neural Network (MLP) | Layers: 5, Neurons in each Layer: 20, 10, 128, 256, 64, 16, 3, Loss: Categorical Cross-Entropy, Optimizer: AdaDelta, Learning Rate: Start: 1.0—Auto Reduce on Plateau Fraction: 0.8 at 2 simultaneous non decline of validation loss |
XgBoost | n_estimators: 600, max_depth = 9, booster: gbtree |
Random Forest | n_estimators: 1000, criterion = ‘gini’, max_depth:7, min_samples_split = 20, min_samples_leaf = 10 |
Support Vector Machine | Kernel = ‘rbf’, degree = 3, gamma = 0.0001 C = 1.0, tol = 0.001, cache_size = 200 |
Moreover as mentioned in the data collection section, the distribution of the MRI scan samples was 203 control, 66 prodromal and 637 Parkinson’s disease, which is considered to be highly imbalanced in nature. The presence of imbalanced data highly affects the performance of the learning models [40,41,42,43,44]. Therefore, presently there are multiple techniques that have been developed to tackle such problems such as the undersampling of the data, the oversampling of the data, synthetic minority oversampling technique (SMOTE) [45], but in the present study, such methods of increasing or decreasing the cardinality of the dataset were not used rather a class weight-based method was utilized [46]. The class weights were basically calculated for each class based upon the number of samples it possesses in the dataset with respect to the total number of samples in the dataset. This method was utilized to create a weighting mechanism for the calculation of the loss function and the class with minority samples are weighted more during the training process. For determining the class weights a specific technique was used which is given as follows:
where the tuning_parameter is a constant value that needs to be iteratively tuned and for the study, it was chosen as 0.5. Table 9 below shows the class weights that were chosen for each class.
Table 9.
Classifier | Specification |
---|---|
Control | 0.3486 |
Prodromal | 0.8365 |
Parkinson’s Disease | 0.14 |
5. Results
The developed machine learning algorithms uncovered pretty astounding and effective results for the detection of Parkinson’s disease from 3D MRI scans. Table 10 below shows the comparative analysis between the four different classifiers that were used for learning the textural, morphological and statistical features of the ROI’s of MRI scans and plots the results of the five split cross-validation which were used for determining the generalizability of the model. The scores mentioned in Table 10 are based on the validation set of each cross-validation split. From the comparative analysis, it was found that the artificial neural network in the second spit outperformed all the other classifiers by giving an overall accuracy, precision, recall and F1 score of 95.3%, 0.9728, 0.9541, and 0.94 respectively. Moreover, having artificial neural networks in the production environment and real-time implementation is also beneficial as it provides support for incremental learning.
Table 10.
Metrics | Test Set | Artificial Neural Network | XgBoost | Random Forest Classifier | Support Vector Machine |
---|---|---|---|---|---|
Accuracy | Split 1 | 94.74% | 88.23% | 85.26% | 79.15% |
Precision | 0.952 | 0.9025 | 0.8715 | 0.8025 | |
Recall | 0.9125 | 0.8947 | 0.8352 | 0.7744 | |
F1-Score | 0.9655 | 0.9133 | 0.8549 | 0.80 | |
Accuracy | Split 2 | 95.3% | 90.52% | 87.32% | 81.74% |
Precision | 0.9728 | 0.9154 | 0.9047 | 0.8241 | |
Recall | 0.9541 | 0.8922 | 0.8678 | 0.8071 | |
F1-Score | 0.94 | 0.9257 | 0.88 | 0.8178 | |
Accuracy | Split 3 | 92.8% | 87.1% | 82.13% | 78.83% |
Precision | 0.9133 | 0.9068 | 0.8536 | 0.8057 | |
Recall | 0.9052 | 0.8534 | 0.7954 | 0.772 | |
F1-Score | 0.9418 | 0.8724 | 0.8204 | 0.8196 | |
Accuracy | Split 4 | 93.26% | 89.43% | 83.6% | 80.91% |
Precision | 0.9145 | 0.9025 | 0.8572 | 0.8133 | |
Recall | 0.9254 | 0.8741 | 0.8246 | 0.7924 | |
F1-Score | 0.9388 | 0.8835 | 0.8391 | 0.8037 | |
Accuracy | Split 5 | 89.44% | 85.36% | 80.44% | 76.59% |
Precision | 0.8832 | 0.8679 | 0.8278 | 0.7964 | |
Recall | 0.8728 | 0.8321 | 0.7945 | 0.7512 | |
F1-Score | 0.890 | 0.8522 | 0.8127 | 0.7739 |
Figure 7 demonstrates the confusion matrix that was generated based upon the results received from the best performing classifier that is artificial neural network (multi-layer perceptron). Also, from the confusion matrix it can be evidently observed that the results completely align with the initial hypothesis which states the recall of the samples belonging to the Parkinson’s disease class needs to be 100%, in prodromal class, there should be no mispredictions in the control class and recall of the healthy class should be more than 85%.
For the study as we can see above that four different machine learning algorithms were developed for the detection of Parkinson’s disease from 3D MRI scans, but as we can see there remains some inconsistency among the performance of the different machine learning models as the artificial neural network (multi-layer perceptron) model performs the best and the support vector machine performs the worst. Therefore, apart from analyzing just the predictive performance of the machine learning models, uncertainty and prediction confidence analysis also need to be performed for determining the best model. Figure 8, Figure 9 and Figure 10 depicted below shows the quantile-quantile plot (QQ plot) of the prediction probabilities of each class for artificial neural network. In the below-plotted figures, the straight line depicted shows the true probabilistic value (i.e. always 1.0) of a particular sample belonging to a particular class, whereas the red markers show the prediction confidence a particular sample of a particular class.
6. Discussion
In this work, a process was developed for classification of the textural, morphological and statistical features derived from 3D voxels of interests of MRI scans for the detection of Parkinson’s disease. In this study, MRI scans were collected from the PPMI database from three different research groups namely, control, prodromal and Parkinson’s disease. The first stage of the work was to identify the ROI’s that are responsible for Parkinson’s disease and are affected during the process of neurodegeneration in older adults. Therefore eight subcortical structures from the MRI scan were chosen for the specific task. The eight subcortical structures are the caudate nucleus, putamen, globus pallidus internus and externus (GPi and GPe), thalamus, STN, substantia nigra (SN), and red nucleus (RN). For the segmentation of the eight subcortical structures from the MRI scans, an atlas-based segmentation was used for extracting the voxels of interest from the MRI scans. The voxels of the acquired MRI scans were registered into the MNI space using affine and symmetric registration to generalize all the acquired MRI scans into a particular space. Further, the MRI scans are subjected to a segmentation routine to fetch only the voxels from the MRI scans which are from the eight subcortical surfaces. Post extraction of the voxels of interest from the ROI regions, the primary motive is to extract the features from voxels of interest.
For the feature engineering process a multitude of features belonging to textural, morphological and statistical domains. The features that were engineered from the 3D arrays of the voxels of interest were first order statistical features, shape-based (2D & 3D) features, gray level cooccurrence matrix features, gray level run length matrix features, gray level size zone matrix features, neighbouring gray tone difference matrix features and gray level dependence matrix features. In total 107 exhaustive features were calculated from the extracted voxels. Now as there were such a huge number of features in the exhaustive list and multiple features were highly correlated with each other. Therefore, the implementation of a feature selection technique for selecting the best features came in as a requirement. For the feature selection process, a two-level selection paradigm was used which consisted of correlation analysis using the filter method (Pearson’s correlation coefficient) followed by recursive feature elimination. In the process of correlation analysis of the features, 42 features were rejected out of 107 exhaustive features and 65 features were selected. The exclusion principle of the features based upon the correlation analysis was performed by considering a correlation coefficient of >90%. After correlation analysis, a routine of recursive feature elimination was performed on the remaining 65 features and the top 20 features were selected based upon the feature importance.
The final segment of the study was concerned about the development of learning algorithms for identifying control, prodromal and Parkinson’s disease from the MRI scans. For the development of the algorithms, a comparative analysis was performed by training four different machine learning algorithms with extracted features. The four different algorithms that were used are artificial neural network, XgBoost, random forest classifier, and support vector machine. Moreover, a 5-split cross-validation was performed across all the classifiers to check the generalizability of the model. From the results, it was observed that the artificial neural network performed the best and gave an overall accuracy of 95.3%, overall recall of 95.41%, the overall precision of 97.28% and f1-score of 94% respectively. Moreover, the artificial neural network model performed robustly by classifying all the samples belonging to Parkinson’s disease correctly with a confidence of 91.9%. Therefore, in the end, the best performing classifier was selected as the final machine learning model for the study.
7. Conclusions
In this proposed study, a 3D MRI analysis was performed by leveraging textural, morphological and statistical features from the voxels of interest for the detection of Parkinson’s disease. The study performed an atlas-based segmentation on 3D MRI images to extract eight subcortical structures namely the caudate nucleus, putamen, Globus pallidus internus and externus (GPi and GPe), thalamus, STN, substantia nigra (SN), and red nucleus (RN) and perform feature engineering on the extracted voxels of interest. The engineered features were also subjected to a feature selection method using correlation analysis and recursive feature elimination to fetch the best performing features. Post feature extraction the study also performed a comparative analysis on learning algorithms by leveraging four machine learning algorithms and determine the best performing model using the classification performance metrics. After the development of the learning model it was found that the artificial neural networks performed the best in terms of classifying Parkinson’s disease and also aligned with the initial hypothesis that was developed before initiating the machine learning model development The developed artificial neural network performed the best by plotting an overall accuracy of 95.3%, overall recall of 95.41%, the overall precision of 97.28% and F1-score of 94% respectively.
To conclude, the outcome of the proposed study is very motivating. However, there is still a huge scope of untouched study when it comes to the analysis of the voxels of interest or MRI scans for the detection of Parkinson’s disease. Moreover, this study was purely based on the principles and the scope of 1st generation artificial intelligence where the ground knowledge of the researcher or the developer is used for feature engineering and then the development of the learning model, but with the advent of 2nd generation artificial intelligence which consists of deep learning, reinforcement learning, etc., now the algorithms have the capability to learn the fetch feature representations from the data to map them with a particular outcome. Therefore, in upcoming studies, it is very much recommended that more research should be performed on a particular topic to understand the capability of the artificial intelligence in whole to detect Parkinson’s disease.
Author Contributions
Conceptualization was done by S.C., S.A.; methodology was done by S.C., S.A.; validation was done by S.C., S.A. and H.-C.K.; formal analysis was done by S.C., S.A. and H.-C.K.; writing original draft was done by S.C. and S.A.; writing-original draft preparation, S.A., S.C.; writing-review and editing, S.A., S.C.; supervision, H.-C.K.; project administration, H.-C.K.; funding acquisition, H.-C.K. All authors have read and agreed to the published version of the manuscript.
Funding
This research was supported by the Ministry of Trade, Industry, and Energy (MOTIE), Korea, through the Education program for Creative and Industrial Convergence (Grant number N0000717).
Conflicts of Interest
The authors declare no conflict of interest
References
- 1.Beitz J.M. Parkinson disease: A review. Front. Biosci. 2014;6:65–74. doi: 10.2741/S415. [DOI] [PubMed] [Google Scholar]
- 2.Aich S., Joo M.I., Kim HCPark J. Improvisation of classification performance based on feature optimization for differentiation of Parkinson’s disease from other neurological diseases using gait characteristics. Int. J. Electr. Comput. Eng. 2019;9:2088–8708. doi: 10.11591/ijece.v9i6.pp5176-5184. [DOI] [Google Scholar]
- 3.Aich S., Pradhan P., Park J., Sethi N., Vathsa VKim H.C. A validation study of freezing of gait (FoG) detection and machine-learning-based FoG prediction using estimated gait characteristics with a wearable accelerometer. Sensors. 2018;18:3287. doi: 10.3390/s18103287. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Larroza A., Moratal D., Paredes-Sánchez A., Soria-Olivas E., Chust M.L., Arribas L.A., Arana E. Support vector machine classification of brain metastasis and radiation necrosis based on texture analysis in MRI. J. Magn. Reson. Imaging. 2015;42:1362–1368. doi: 10.1002/jmri.24913. [DOI] [PubMed] [Google Scholar]
- 5.Castellano G., Bonilha L., Li L.M., Cendes F. Texture analysis of medical images. Clin. Radiol. 2004;59:1061–1069. doi: 10.1016/j.crad.2004.07.008. [DOI] [PubMed] [Google Scholar]
- 6.Larroza A., Bodí V., Moratal D. Assessment of Cellular and Organ Function and Dysfunction Using Direct and Derived MRI Methodologies. University of Oxford; Oxford, UK: 2016. Texture analysis in magnetic resonance imaging: Review and considerations for future applications; pp. 75–106. [Google Scholar]
- 7.Juntu J., Sijbers J., De Backer S., Rajan J., Van Dyck D. Machine learning study of several classifiers trained with texture analysis features to differentiate benign from malignant soft-tissue tumors in T1-MRI images. J. Magn. Reson. Imaging Off. J. Int. Soc. Magn. Reson. Med. 2010;31:680–689. doi: 10.1002/jmri.22095. [DOI] [PubMed] [Google Scholar]
- 8.Zacharaki E.I., Wang S., Chawla S., Soo Yoo D., Wolf R., Melhem E.R., Davatzikos C. Classification of brain tumor type and grade using MRI texture and shape in a machine learning scheme. Magn. Reson. Med. Off. J. Int. Soc. Magn. Reson. Med. 2009;62:1609–1618. doi: 10.1002/mrm.22147. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.De Oliveira M.S., Balthazar M.L.F., D’abreu A., Yasuda C.L., Damasceno B.P., Cendes F., Castellano G. MR imaging texture analysis of the corpus callosum and thalamus in amnestic mild cognitive impairment and mild Alzheimer disease. Am. J. Neuroradiol. 2011;32:60–66. doi: 10.3174/ajnr.A2232. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Santos T.A., Maistro C.E.B., Silva C.B., Oliveira M.S., França M.C., Castellano G. MRI texture analysis reveals bulbar abnormalities in Friedreich ataxia. Am. J. Neuroradiol. 2015;36:2214–2218. doi: 10.3174/ajnr.A4455. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Ahmed E.F., Novak J., Peet A.C., Arvanitis T.N. 3D texture analysis of MR images to improve classification of paediatric brain tumours: A preliminary study. Integr. Inf. Technol. Manag. Qual. Care. 2014;202:213. [PubMed] [Google Scholar]
- 12.Lundervold A.S., Lundervold A. An overview of deep learning in medical imaging focusing on MRI. Z. Für Med. Phys. 2019;29:102–127. doi: 10.1016/j.zemedi.2018.11.002. [DOI] [PubMed] [Google Scholar]
- 13.Lee Y.H. Efficiency improvement in a busy radiology practice: Determination of musculoskeletal magnetic resonance imaging protocol using deep-learning convolutional neural networks. J. Digit. Imaging. 2018;31:604–610. doi: 10.1007/s10278-018-0066-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Feng X., Yang J., Laine A.F., Angelini E.D. Alzheimer’s disease diagnosis based on anatomically stratified texture analysis of the hippocampus in structural MRI; Proceedings of the 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018); Washington, DC, USA. 4–7 April 2018; pp. 1546–1549. [Google Scholar]
- 15.Martinez-Murcia F.J., Górriz J.M., Ramírez J., Segovia F., Salas-Gonzalez D., Castillo-Barnes D., Illán I.A., Ortiz A. Annual Conference on Medical Image Understanding and Analysis. Springer; Cham, Switzerland: 2017. Alzheimer’s Disease Neuroimaging Initiative, Evaluating Alzheimer’s Disease Diagnosis Using Texture Analysis; pp. 470–481. [Google Scholar]
- 16.Sikiö M., Holli-Helenius K.K., Harrison L.C., Ryymin P., Ruottinen H., Saunamäki T., Eskola H.J., Elovaara I., Dastidar P. MR image texture in Parkinson’s disease: A longitudinal study. Acta Radiol. 2015;56:97–104. doi: 10.1177/0284185113519775. [DOI] [PubMed] [Google Scholar]
- 17.Betrouni N., Lopes R., Defebvre L., Leentjens A.F., Dujardin K. Texture features of magnetic resonance images: A marker of slight cognitive deficits in Parkinson’s disease. Mov. Disord. 2019 doi: 10.1002/mds.27931. [DOI] [PubMed] [Google Scholar]
- 18.Li G., Zhai G., Zhao X., An H., Spincemaille P., Gillen K.M., Ku Y., Wang Y., Huang D., Li J. 3D texture analyses within the substantia nigra of Parkinson’s disease patients on quantitative susceptibility maps and R2∗ maps. Neuroimage. 2019;188:465–472. doi: 10.1016/j.neuroimage.2018.12.041. [DOI] [PubMed] [Google Scholar]
- 19.Zhang J., Yu C., Jiang G., Liu W., Tong L. 3D texture analysis on MRI images of Alzheimer’s disease. Brain Imaging Behav. 2012;6:61–69. doi: 10.1007/s11682-011-9142-3. [DOI] [PubMed] [Google Scholar]
- 20.Lee S., Lee H., Kim K.W. Magnetic resonance imaging texture predicts progression to dementia due to Alzheimer disease earlier than hippocampal volume. J. Psychiatry Neurosci. JPN. 2019;44:1–8. doi: 10.1503/jpn.180171. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Li X., Xia H., Zhou Z., Tong L. 3D texture analysis of hippocampus based on MR images in patients with Alzheimer disease and mild cognitive impairment; Proceedings of the 2010 3rd international conference on biomedical engineering and informatics; Yantai, China. 16–18 October 2010; pp. 1–4. [Google Scholar]
- 22.Xiao Z., Ding Y., Lan T., Zhang C., Luo C., Qin Z. Brain MR image classification for Alzheimer’s disease diagnosis based on multifeature fusion. Comput. Math. Methods Med. 2017;2017:1–13. doi: 10.1155/2017/1952373. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Maani R., Yang Y.H., Kalra S. Voxel-based texture analysis of the brain. PLoS ONE. 2015;10:e0117759. doi: 10.1371/journal.pone.0117759. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Ta D., Khan M., Ishaque A., Seres P., Eurich D., Yang Y.H., Kalra S. Reliability of 3D texture analysis: A multicenter MRI study of the brain. J. Magn. Reson. Imaging. 2019 doi: 10.1002/jmri.26904. [DOI] [PubMed] [Google Scholar]
- 25.Alemán-Gómez Y. IBASPM: Toolbox for automatic parcellation of brain structures; Proceedings of the 12th Annual Meeting of the Organization for Human Brain Mapping; Florence, Italy. 11–15 June 2006. [Google Scholar]
- 26.Xiao Y., Fonov V., Beriault S., Subaie F.A., Chakravarty M.M., Sadikot A.F., Bruce Pike G., Louis Collins D. A dataset of multi-contrast population-averaged brain MRI atlases of a Parkinson’s disease cohort. Data Brief. 2017;12:370–379. doi: 10.1016/j.dib.2017.04.013. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Xiao Y., Fonov V., Beriault S., Subaie F.A., Chakravarty M.M., Sadikot A.F., Bruce Pike G., Louis Collins D. Multi-contrast unbiased MRI atlas of a Parkinson’s disease population. Int. J. Comput. Assist. Radiol. Surg. 2015;10:329–341. doi: 10.1007/s11548-014-1068-y. [DOI] [PubMed] [Google Scholar]
- 28.Xiao Y., Beriault S., Bruce Pike G., Louis Collins D. Multicontrast multiecho FLASH MRI for targeting the subthalamic nucleus. Magn. Reson. Imaging. 2012;30:627–640. doi: 10.1016/j.mri.2012.02.006. [DOI] [PubMed] [Google Scholar]
- 29.Avants B.B., Tustison N., Song G. Advanced normalization tools (ANTS) Insight J. 2009;2:1–35. [Google Scholar]
- 30.Tuite P.J., Mangia S., Michaeli S. Magnetic resonance imaging (MRI) in Parkinson’s disease. J. Alzheimer’s Dis. Parkinsonism. 2013;1 doi: 10.4172/2161-0460.S1-001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Pyatigorskaya N., Magnin B., Mongin M., Yahia-Cherif L., Valabregue R., Arnaldi D., Ewenczyk C., Poupon C., Vidailhet M., Lehéricy S. Comparative study of MRI biomarkers in the substantia nigra to discriminate idiopathic Parkinson disease. Am. J. Neuroradiol. 2018;39:1460–1467. doi: 10.3174/ajnr.A5702. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Rosenberg-Katz K., Herman T., Jacob Y., Kliper E., Giladi N., Hausdorff J.M. Subcortical volumes differ in Parkinson’s disease motor subtypes: New insights into the pathophysiology of disparate symptoms. Front. Hum. Neurosci. 2016;10:356. doi: 10.3389/fnhum.2016.00356. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Prakash K.G., Bannur B.M., Chavan M.D., Saniya K., Sailesh K.S., Rajagopalan A. Neuroanatomical changes in Parkinson’s disease in relation to cognition: An update. J. Adv. Pharm. Technol. Res. 2016;7:123. doi: 10.4103/2231-4040.191416. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Mazziotta J.C., Toga A.W., Evans A.C., Fox P., Lancaster J., Mazziotta J.A., Toga A.W. A probabilistic atlas of the human brain: Theory and rationale for its development. NeuroImage. 1995;2:89–101. doi: 10.1006/nimg.1995.1012. [DOI] [PubMed] [Google Scholar]
- 35.Evans A.C., Fox P.T., Lancaster J., Zilles K., Woods R., Paus T., Simpson G., Pike B., Holmes C., Collins D.L., et al. A probabilistic atlas and reference system for the human brain: International Consortium for Brain Mapping (ICBM) Philos. Trans. R. Soc. Lond. B Biol. Sci. 2001;356:1293–1322. doi: 10.1098/rstb.2001.0915. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Mazziotta J.C., Toga A.W., Evans A.C., Fox P.T., Lancaster J., Zilles K., Woods R., Paus T., Simpson G., Pike B., et al. International Consortium for Brain Mapping. Four-dimensional probabilistic atlas of the human brain. J. Am. Med. Inform. Assoc. (JAMIA) 2001;8:401–430. doi: 10.1136/jamia.2001.0080401. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Van Griethuysen J.J.M., Fedorov A., Parmar C., Hosny A., Aucoin N., Narayan V., Beets-Tan R.G.H., Fillon-Robin J.C., Pieper S., Aerts H.J.W.L. Computational Radiomics System to Decode the Radiographic Phenotype. Cancer Research. Cancer Res. 2017;77:e104–e107. doi: 10.1158/0008-5472.CAN-17-0339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Lorensen W.E., Cline H.E. Marching cubes: A high-resolution 3D surface construction algorithm. ACM Siggraph Comput. Graph. Internet. 1987;21:163–169. doi: 10.1145/37402.37422. [DOI] [Google Scholar]
- 39.Guyon I., Weston J., Barnhill S., Vapnik V. Gene Selection for Cancer Classification Using Support Vector Machines. Mach. Learn. 2002;46:389–422. doi: 10.1023/A:1012487302797. [DOI] [Google Scholar]
- 40.Thibault G., Fertil B., Navarro C., Pereira S., Cau P., Levy N., Sequeira J., Mari J. Texture Indexes and Gray Level Size Zone Matrix. Application to Cell Nuclei Classification; Proceedings of the Pattern Recognition and Information Processing (PRIP); Minsk, Belarus. 19–21 May 2009. [Google Scholar]
- 41.Krawczyk B. Learning from imbalanced data: Open challenges and future directions. Prog. Artif. Intell. 2016;5:221–232. doi: 10.1007/s13748-016-0094-0. [DOI] [Google Scholar]
- 42.Wu D., Wang Z., Chen Y., Zhao H. Mixed-kernel based weighted extreme learning machine for inertial sensor based human activity recognition with imbalanced dataset. Neurocomputing. 2016;190:35–49. doi: 10.1016/j.neucom.2015.11.095. [DOI] [Google Scholar]
- 43.M’hamed Abidine B., Fergani B., Oussalah M., Fergani L. A new classification strategy for human activity recognition using cost sensitive support vector machines for imbalanced data. Kybernetes. 2014;43:1150–1164. doi: 10.1108/K-07-2014-0138. [DOI] [Google Scholar]
- 44.Fergani B., Clavier L. Importance-weighted the imbalanced data for C-SVM classifier to human activity recognition; Proceedings of the 2013 8th International Workshop on Systems, Signal Processing and their Applications (WoSSPA); Algeria, Zalalada. 12–15 May 2013; pp. 330–335. [Google Scholar]
- 45.Chawla N.V., Bowyer K.W., Hall L.O., Kegelmeyer W.P. SMOTE: Synthetic minority over-sampling technique. J. Artif. Intell. Res. 2002;16:321–357. doi: 10.1613/jair.953. [DOI] [Google Scholar]
- 46.Aich S., Chakraborty S., Sim J.-S., Jang D.-J., Kim H.-C. The Design of an Automated System for the Analysis of the Activity and Emotional Patterns of Dogs with Wearable Sensors Using Machine Learning. Appl. Sci. 2019;9:4938. doi: 10.3390/app9224938. [DOI] [Google Scholar]