TABLE VII.
More parameters were explored to develop machine learning models using structural MRI data. Sigma representing the Gaussian kernels was considered, including four values. The idea behind employing nine metrics to evaluate the performance of classification of the models, as explained above, is applied to MCADNNet models using structural MRI data. The qualitative analyses show that the measures are highly correlated with accuracy rates obtained from the previous analysis. As mentioned in the fMRI analysis, the findings allowed us to use the accuracy rates for model comparisons.
| MCADNNet - Structural MRI | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Precision | Recall | F1-Score | |||||||||
| Experiment | Repetition | σ | Micro Avg. | Macro Avg. | Weighted Avg. | Micro Avg. | Macro Avg. | Weighted Avg | Micro Avg. | Macro Avg. | Weighted Avg. |
| 1 | S0 | 0.98 | 0.98 | 0.98 | 0.98 | 0.96 | 0.98 | 0.98 | 0.97 | 0.98 | |
| S2 | 0.98 | 0.98 | 0.98 | 0.98 | 0.96 | 0.98 | 0.98 | 0.97 | 0.98 | ||
| S3 | 0.98 | 0.98 | 0.98 | 0.98 | 0.94 | 0.98 | 0.98 | 0.96 | 0.98 | ||
| S4 | 0.98 | 0.98 | 0.98 | 0.98 | 0.94 | 0.98 | 0.98 | 0.96 | 0.98 | ||
| 2 | S0 | 0.98 | 0.98 | 0.98 | 0.98 | 0.95 | 0.98 | 0.98 | 0.96 | 0.98 | |
| S2 | 0.98 | 0.98 | 0.98 | 0.98 | 0.95 | 0.98 | 0.98 | 0.96 | 0.98 | ||
| S3 | 0.98 | 0.98 | 0.98 | 0.98 | 0.94 | 0.98 | 0.98 | 0.96 | 0.98 | ||
| S4 | 0.98 | 0.98 | 0.98 | 0.98 | 0.94 | 0.98 | 0.98 | 0.96 | 0.98 | ||
| AD_NC | 3 | S0 | 0.99 | 0.98 | 0.99 | 0.99 | 0.96 | 0.99 | 0.99 | 0.97 | 0.99 |
| S2 | 0.98 | 0.98 | 0.98 | 0.98 | 0.96 | 0.98 | 0.98 | 0.97 | 0.98 | ||
| S3 | 0.98 | 0.98 | 0.98 | 0.98 | 0.96 | 0.98 | 0.98 | 0.97 | 0.98 | ||
| S4 | 0.98 | 0.98 | 0.98 | 0.98 | 0.96 | 0.98 | 0.98 | 0.97 | 0.98 | ||
| 4 | S0 | 0.99 | 0.98 | 0.99 | 0.99 | 0.97 | 0.99 | 0.99 | 0.97 | 0.99 | |
| S2 | 0.99 | 0.98 | 0.99 | 0.99 | 0.97 | 0.99 | 0.99 | 0.97 | 0.99 | ||
| S3 | 0.98 | 0.97 | 0.98 | 0.98 | 0.95 | 0.98 | 0.98 | 0.96 | 0.98 | ||
| S4 | 0.97 | 0.95 | 0.97 | 0.97 | 0.93 | 0.97 | 0.97 | 0.94 | 0.97 | ||
| 5 | S0 | 0.96 | 0.95 | 0.96 | 0.96 | 0.9 | 0.96 | 0.96 | 0.92 | 0.96 | |
| S2 | 0.97 | 0.95 | 0.97 | 0.97 | 0.93 | 0.97 | 0.97 | 0.94 | 0.97 | ||
| S3 | 0.95 | 0.94 | 0.95 | 0.95 | 0.87 | 0.95 | 0.95 | 0.9 | 0.95 | ||
| S4 | 0.97 | 0.95 | 0.97 | 0.97 | 0.92 | 0.97 | 0.97 | 0.93 | 0.97 | ||
| 1 | S0 | 0.94 | 0.95 | 0.94 | 0.94 | 0.93 | 0.94 | 0.94 | 0.94 | 0.94 | |
| S2 | 0.94 | 0.95 | 0.94 | 0.94 | 0.91 | 0.94 | 0.94 | 0.93 | 0.94 | ||
| S3 | 0.94 | 0.95 | 0.94 | 0.94 | 0.93 | 0.94 | 0.94 | 0.94 | 0.94 | ||
| S4 | 0.94 | 0.95 | 0.94 | 0.94 | 0.92 | 0.94 | 0.94 | 0.93 | 0.94 | ||
| 2 | S0 | 0.94 | 0.95 | 0.94 | 0.94 | 0.92 | 0.94 | 0.94 | 0.93 | 0.94 | |
| S2 | 0.95 | 0.96 | 0.95 | 0.95 | 0.94 | 0.95 | 0.95 | 0.95 | 0.95 | ||
| S3 | 0.95 | 0.95 | 0.95 | 0.95 | 0.94 | 0.95 | 0.95 | 0.94 | 0.95 | ||
| S4 | 0.95 | 0.96 | 0.95 | 0.95 | 0.94 | 0.95 | 0.95 | 0.95 | 0.95 | ||
| AD_NC_MCI | 3 | S0 | 0.94 | 0.95 | 0.94 | 0.94 | 0.92 | 0.94 | 0.94 | 0.93 | 0.94 |
| S2 | 0.95 | 0.96 | 0.95 | 0.95 | 0.94 | 0.95 | 0.95 | 0.95 | 0.95 | ||
| S3 | 0.95 | 0.95 | 0.95 | 0.95 | 0.94 | 0.95 | 0.95 | 0.94 | 0.95 | ||
| S4 | 0.95 | 0.96 | 0.95 | 0.95 | 0.93 | 0.95 | 0.95 | 0.94 | 0.95 | ||
| 4 | S0 | 0.95 | 0.96 | 0.95 | 0.95 | 0.94 | 0.95 | 0.95 | 0.95 | 0.95 | |
| S2 | 0.95 | 0.95 | 0.95 | 0.95 | 0.93 | 0.95 | 0.95 | 0.94 | 0.95 | ||
| S3 | 0.95 | 0.96 | 0.95 | 0.95 | 0.93 | 0.95 | 0.95 | 0.94 | 0.95 | ||
| S4 | 0.88 | 0.88 | 0.88 | 0.88 | 0.84 | 0.88 | 0.88 | 0.86 | 0.88 | ||
| 5 | S0 | 0.89 | 0.89 | 0.89 | 0.89 | 0.87 | 0.89 | 0.89 | 0.88 | 0.89 | |
| S2 | 0.87 | 0.88 | 0.87 | 0.87 | 0.85 | 0.87 | 0.87 | 0.86 | 0.87 | ||
| S3 | 0.88 | 0.88 | 0.88 | 0.88 | 0.86 | 0.88 | 0.88 | 0.87 | 0.88 | ||
| S4 | 0.88 | 0.88 | 0.88 | 0.88 | 0.85 | 0.88 | 0.88 | 0.86 | 0.88 | ||
| 1 | S0 | 0.95 | 0.95 | 0.95 | 0.95 | 0.94 | 0.95 | 0.95 | 0.95 | 0.95 | |
| S2 | 0.95 | 0.95 | 0.95 | 0.95 | 0.94 | 0.95 | 0.95 | 0.94 | 0.95 | ||
| S3 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | ||
| S4 | 0.94 | 0.94 | 0.94 | 0.94 | 0.94 | 0.94 | 0.94 | 0.94 | 0.94 | ||
| 2 | S0 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | |
| S2 | 0.95 | 0.96 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | ||
| S3 | 0.96 | 0.96 | 0.96 | 0.96 | 0.95 | 0.96 | 0.96 | 0.95 | 0.96 | ||
| S4 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | ||
| AD_MCI | 3 | S0 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 |
| S2 | 0.96 | 0.96 | 0.96 | 0.96 | 0.95 | 0.96 | 0.96 | 0.96 | 0.96 | ||
| S3 | 0.96 | 0.96 | 0.96 | 0.96 | 0.95 | 0.96 | 0.96 | 0.96 | 0.96 | ||
| S4 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | ||
| 4 | S0 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | |
| S2 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | 0.95 | ||
| S3 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | ||
| S4 | 0.9 | 0.89 | 0.9 | 0.9 | 0.89 | 0.9 | 0.9 | 0.89 | 0.9 | ||
| 5 | S0 | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | |
| S2 | 0.88 | 0.88 | 0.88 | 0.88 | 0.88 | 0.88 | 0.88 | 0.88 | 0.88 | ||
| S3 | 0.9 | 0.9 | 0.9 | 0.9 | 0.89 | 0.9 | 0.9 | 0.9 | 0.9 | ||
| S4 | 0.9 | 0.89 | 0.9 | 0.9 | 0.89 | 0.9 | 0.9 | 0.89 | 0.9 | ||
| 1 | S0 | 0.99 | 0.99 | 0.99 | 0.99 | 0.96 | 0.99 | 0.99 | 0.97 | 0.99 | |
| S2 | 0.99 | 0.99 | 0.99 | 0.99 | 0.95 | 0.99 | 0.99 | 0.97 | 0.99 | ||
| S3 | 0.99 | 0.98 | 0.99 | 0.99 | 0.95 | 0.99 | 0.99 | 0.97 | 0.99 | ||
| S4 | 0.99 | 0.98 | 0.98 | 0.99 | 0.95 | 0.99 | 0.99 | 0.96 | 0.98 | ||
| 2 | S0 | 0.98 | 0.98 | 0.98 | 0.98 | 0.95 | 0.98 | 0.98 | 0.96 | 0.98 | |
| S2 | 0.99 | 0.98 | 0.98 | 0.99 | 0.95 | 0.99 | 0.99 | 0.96 | 0.98 | ||
| S3 | 0.99 | 0.99 | 0.99 | 0.99 | 0.97 | 0.99 | 0.99 | 0.98 | 0.99 | ||
| S4 | 0.99 | 0.98 | 0.99 | 0.99 | 0.96 | 0.99 | 0.99 | 0.97 | 0.99 | ||
| NC_MCI | 3 | S0 | 0.99 | 0.99 | 0.99 | 0.99 | 0.95 | 0.99 | 0.99 | 0.97 | 0.99 |
| S2 | 0.99 | 0.98 | 0.99 | 0.99 | 0.95 | 0.99 | 0.99 | 0.97 | 0.99 | ||
| S3 | 0.99 | 0.98 | 0.99 | 0.99 | 0.96 | 0.99 | 0.99 | 0.97 | 0.99 | ||
| S4 | 0.99 | 0.99 | 0.99 | 0.99 | 0.96 | 0.99 | 0.99 | 0.97 | 0.99 | ||
| 4 | S0 | 0.99 | 0.98 | 0.99 | 0.99 | 0.96 | 0.99 | 0.99 | 0.97 | 0.99 | |
| S2 | 0.99 | 0.98 | 0.99 | 0.99 | 0.95 | 0.99 | 0.99 | 0.97 | 0.99 | ||
| S3 | 0.99 | 0.98 | 0.99 | 0.99 | 0.96 | 0.99 | 0.99 | 0.97 | 0.99 | ||
| S4 | 0.97 | 0.95 | 0.97 | 0.97 | 0.91 | 0.97 | 0.97 | 0.93 | 0.97 | ||
| 5 | S0 | 0.97 | 0.96 | 0.97 | 0.97 | 0.9 | 0.97 | 0.97 | 0.93 | 0.97 | |
| S2 | 0.97 | 0.96 | 0.97 | 0.97 | 0.92 | 0.97 | 0.97 | 0.94 | 0.97 | ||
| S3 | 0.98 | 0.96 | 0.98 | 0.98 | 0.95 | 0.98 | 0.98 | 0.96 | 0.98 | ||
| S4 | 0.97 | 0.95 | 0.97 | 0.97 | 0.92 | 0.97 | 0.97 | 0.94 | 0.97 | ||