Abstract
Background
Alzheimer’s disease (AD) is assessed by carefully examining a patient’s cognitive impairment. However, previous studies reported inadequate diagnostic accuracy for dementia in primary care settings. Many hospitals use the automated quantitative evaluation method known as the Voxel-based Specific Regional Analysis System for Alzheimer’s Disease (VSRAD), wherein brain MRI data are used to evaluate brain morphological abnormalities associated with AD. Similarly, an automated quantitative evaluation application called the easy Z-score imaging system (eZIS), which uses brain SPECT data to detect regional cerebral blood flow decreases associated with AD, is widely used. These applications have several indicators, each of which is known to correlate with the degree of AD. However, it is not completely known whether these indicators work better when used in combination in real-world clinical practice.
Methods
We included 112 participants with mild cognitive impairment (MCI) and 128 participants with early AD in this study. All participants underwent MRI, SPECT, and the Mini-Mental State Examination (MMSE). Demographic and clinical characteristics were assessed by univariate analysis, and logistic regression analysis with a combination of MMSE, VSRAD and eZIS indicators was performed to verify whether the diagnostic accuracy in discriminating between MCI and early AD was improved.
Results
The area under the receiver operating characteristic curve (AUC) for the MMSE score alone was 0.835. The AUC was significantly improved to 0.870 by combining the MMSE score with two quantitative indicators from the VSRAD and eZIS that assessed the extent of brain abnormalities.
Conclusion
Compared with the MMSE score alone, the combination of the MMSE score with the VSRAD and eZIS indicators significantly improves the accuracy of discrimination between patients with MCI and early AD. Implementing VSRAD and eZIS does not require professional clinical experience in the treatment of dementia. Therefore, the accuracy of dementia diagnosis by physicians may easily be improved in real-world primary care settings.
Introduction
Dementia is an important disease characterized by progressive cognitive impairment and social dysfunction [1]. In particular, Alzheimer’s disease (AD) accounts for approximately 70% of dementia cases [2] and often occurs in patients in their 70s and 80s. Additionally, the prevalence increases exponentially with aging [2]. The diagnosis of dementia is assessed by carefully examining a patient’s cognitive impairment and function in daily life according to international diagnostic criteria such as the International Statistical Classification of Diseases and Related Health Problems 10th edition (ICD-10) and the Diagnostic and Statistical Manual of Mental Disorders 5th edition (DSM-5) [3]. More than half of patients with mild cognitive impairment (MCI) progress to dementia within 5 years, but some MCI patients may remain MCI stable or return to normal cognition over time [4–6]. For this reason, accurate discrimination between MCI and early AD is important [4, 7, 8], especially when considering therapeutic interventions and the prognosis of dementia [4, 8, 9].
However, due to the rapid increase in the number of patients, diagnosis and treatment are not always performed by doctors who have clinical experienced with dementia. Therefore, the Mini-Mental State Examination (MMSE) is being developed as a screening tool to assist in the diagnosis of dementia [10]. This tool is a simple test consisting of questions asked by an evaluator and is often used in primary care settings. A recent meta-analysis reported that the MMSE has a sensitivity of 78.4% and a specificity of 87.8% in distinguishing between AD and MCI in primary care settings [11].
However, it is difficult to exclude cerebral organic diseases with only the MMSE, and the accuracy of this examination in distinguishing MCI from AD is inferior to the diagnostic accuracy of a specialist [11]. Therefore, it is necessary to try to improve the accuracy by combining it with other assessment methods.
At this point, brain imaging analyses are useful in the differential diagnosis of dementia and are often used in a qualitative manner to exclude organic disorders such as stroke, brain tumors, normal pressure hydrocephalus, and encephalitis. Recently, the performance of brain imaging analyses has improved, and the quantitative analysis of brain morphology and function has become possible, making it a powerful auxiliary tool for dementia diagnosis [12, 13].
It has been reported that medial temporal lobe atrophy is a characteristic morphological change in AD. The automated quantitative evaluation application called the Voxel-based Specific Regional Analysis System for Alzheimer’s Disease (VSRAD), which uses brain magnetic resonance imaging (MRI) data to assess the brain morphological abnormalities associated with AD, was developed by Dr. Matsuda and colleagues [14, 15]. VSRAD applies voxel-based morphometry (VBM), which is a method for superimposing plane tomographic images from head MRI and dividing the entire brain into small cubes for statistical analysis [16]. This free software application was updated into VSRAD advance 2 in May 2015, and it is being used in many hospitals. In particular, a Z-score of gray matter atrophy in the volume of interest (VOI) relevant to AD, which measures the severity of medial temporal atrophy, is a representative indicator of VSRAD [15, 17, 18].
Furthermore, characteristic cerebral blood flow decreases in the parietal lobe and posterior cingulate gyrus associated with AD can be assessed by single photon emission computed tomography (SPECT) [19]. An automated quantitative evaluation application called the easy Z-score imaging system (eZIS), which uses brain SPECT data to detect the regional cerebral blood flow decrease in AD, is widely used in Japan [20]. “Severity”, which is one of the quantitative indicators displayed as the Z-score for regional blood flow decrease, is regarded as the most representative eZIS [21].
The VSRAD and eZIS applications have indicators, and each indicator has been reported to correlate with cognitive decline independently [12]. However, previous studies have the limitation of a small sample size, and it is not completely known whether these indicators work better in combination in real-world clinical practice. To address this clinical question, it is necessary to perform multivariate analysis. Hence, we performed a binomial logistic regression analysis combining MMSE scores and VSRAD and eZIS indicators to verify whether the diagnostic accuracy for discriminating between MCI and early AD was improved.
Materials and methods
We recruited MCI and early AD participants from the outpatient department of Towada City Hospital between September 2016 and March 2020. All participants underwent MRI, SPECT, and a battery of laboratory tests, including assessment of thyroid function and vitamin B12, folate and serum ammonia concentrations. Cognitive function was assessed with the MMSE [22], the Revised Hasegawa’s Dementia Scale (HDS-R) [23], the clock-drawing test (CDT) [24], Kohs block design test [25], and Benton visual retention test [26]. A diagnosis of AD was made based on the DSM-5 and ICD-10. A diagnosis of MCI was made according to Petersen’s criteria [27]. We included patients in our study with MMSE scores of 20 or higher to exclude moderate to severe dementia [28]. The exclusion criteria were symptoms of depression, dementia with Lewy bodies, cerebrovascular disease, or any other psychiatric disorder.
MRI procedure
MRI was performed on a 1.5T system (GE Signa Explore, General Electric Co, Boston, USA). Axial, coronal and sagittal T1-weighted sequence (SE) images (repetition time [TR], 520 ms; echo time [TE], 12.0 ms; 5-mm slice thickness) and axial T2-weighted SE images (TR, 3800 ms; TE, 97.0 ms) were obtained for diagnosis. Then, 3D volumetric acquisition of a T1-weighted gradient-echo sequence produced a gapless series of thin sagittal sections using a magnetization-prepared rapid-acquisition gradient-echo sequence (TR, 12.3 ms; TE, 5.1 ms; flip angle, 15°; acquisition matrix, 256 × 256; 1.4-mm slice thickness).
Voxel-based Specific Regional Analysis System for Alzheimer Disease (VSRAD)
The voxel-based analysis system in the present study has been validated [14]. Currently, the software is distributed in Japan under the name Voxel-based Specific Regional Analysis System for Alzheimer Disease advance 2 (VSRAD advance 2, Eisai Co, Tokyo, Japan). In VSRAD advance 2, the DARTEL (diffeomorphic anatomical registration through exponentiated Lie algebra) and SPM8 (Statistical Parametric Mapping 8, Institute of Neurology, London, UK) divide the T1-weighted brain MRI into cerebrospinal fluid, gray matter and white matter, and then, anatomical standardization is performed. Normalized patient data are smoothed with a Gaussian kernel of 8-mm full width at half maximum, and the degree of brain atrophy is assessed for each voxel [29].
VSRAD scores reflect the severity of gray matter loss across the entire brain because the software compares an image with the original normal database template. VSRAD advance 2 automatically calculates the four indicators of AD shown below:
the Z-score of gray matter atrophy severity in the volume of interest of AD (“VSRAD VOI severity”) = ((normal control average of voxel level–patient’s voxel level)/normal control standard deviation),
the extent of gray matter atrophy in the VOI of AD (“VSRAD VOI extent”) = ((number of voxels judged to have a Z-score of more than 2/number of all voxels in the volume of the hippocampus) × 100%),
The extent of gray matter atrophy in the whole brain (“VSRAD GM extent”) = a percentage of voxels with a Z-score >2 compared with the whole brain, and
the ratio of the extent of gray matter atrophy in the VOI to the whole brain (“VSRAD VOI ratio”) = ((number of voxels judged to have a Z-score of more than 2/number of all voxels in the volume of the whole brain) × 100%).
These four indicators of VSRAD have been explained in previous reports [15, 30].
SPECT procedure
The patient received a bolus injection of 99mTc-ethyl cysteinate dimer (ECD) (600 MBq, Fujifilm Toyama Chemical Co, Tokyo, Japan) via the right brachial vein in a comfortable supine position with eyes closed, while awake in quiet surroundings. Twenty minutes after angiography, SPECT images were obtained using a rotating, two-head gamma camera (GE Infinia, General Electric Co, Boston, USA) with low energy high resolution and parallel hole collimators (128 × 128 matrix). The images were reconstructed using Butterworth and ramp filters, and attenuation correction was performed according to Chang’s method.
The easy Z-score imaging system (eZIS)
The eZIS calculates the degree of decrease in cerebral blood flow in each voxel after anatomical standardization of the patient’s brain SPECT data by SPM2 (Statistical Parametric Mapping 2, Wellcome Department of Cognitive Neurology, London, UK).
The images are spatially normalized to an original template by using SPM2, and then, images are smoothed with a Gaussian kernel, 12 mm in full width at half maximum [21].
Subsequently, a voxel-based analysis is performed using a Z-score map calculated through a comparison of a patient’s data with a control database after voxel normalization to global mean cerebral blood flow, Z-score = ([control mean] − [individual value])/(control SD).
The eZIS automatically calculates the following three indicators for characterizing regional cerebral blood flow (rCBF):
The severity of rCBF decrease in a specific region showing rCBF reduction from the averaged positive Z-score in the voxels of interest (bilateral posterior cingulate cortices [PCC], precunei, and parietal cortices) (“eZIS severity”),
The extent of a significant regional rCBF reduction in the voxel of interest by calculating the percentage of coordinates with a Z-value exceeding the threshold value of 2 (“eZIS extent”), and
The ratio of the extent of a region showing significant rCBF reduction in the voxel of interest to the extent of a region showing significant rCBF reduction in the whole brain, which is also the percentage of coordinates with a Z-value exceeding the threshold value of 2 (“eZIS ratio”); this ratio indicates the specificity of the rCBF reduction in the voxel of interest compared with that in the whole brain.
These three indicators of eZIS have been explained in previous reports [20, 31].
Statistical analysis
All statistical analyses were performed with EZR (Saitama Medical Center, Jichi Medical University, Saitama, Japan) [32], which is a graphical user interface for R (The R Foundation for Statistical Computing, Vienna, Austria, version 3.5.2). More precisely, it is a modified version of the R commander that was designed to add statistical functions frequently used in biostatistics.
First, all statistical tests were based on a two-sided significance level of p < 0.05. Demographic and clinical characteristics were analyzed using the chi-square test and Mann–Whitney U test for differences between MCI and early AD patients. For multiple univariate analysis, the Benjamini-Hochberg procedure was used to determine whether each p-value was statistically significant.
Second, a forward-backward stepwise binomial logistic regression analysis based on Akaike’s information criterion (AIC) was performed. MCI or early AD were included in the analysis as dependent variables, and sex, age, education year, MMSE score, VSRAD VOI severity, VSRAD VOI extent, VSRAD GM extent, VSRAD ratio, eZIS severity, eZIS extent and eZIS ratio were used as candidate independent variables. Factors showing significant differences in the univariate analysis were included in the model by the stepwise method. The result of this calculation was named the "stepwise selection model".
Third, receiver operating characteristic (ROC) curve and area under the ROC curve (AUC) analyses for discrimination between MCI and early AD were performed for each VSRAD indicator, each eZIS indicator, and the stepwise selection model. A diagnosis based on the DSM-5 and ICD-10 by psychiatrists certified by the Japanese Society of Psychiatry and Neurology was used as the gold standard.
Ethics
This study was conducted in accordance with the Declaration of Helsinki and the Japanese Ethical Guidelines for Medical and Health Research Involving Human Subjects. Prior to the initiation of the study, the study protocol was reviewed and approved by the institutional review board of the ethics committee of Towada City Hospital (No. 1–4, Approved 12 June 2020). Since this was a retrospective medical record survey, informed consent was exempted, but we instead released information on this research so that patients were free to opt out.
A contact information for our ethics committee: The institutional review board of the ethics committee of Towada City Hospital (Chairperson of the ethics committee: Dr. Masaru Kudo); Towanda City, Nishi 12-14-8, Aomori Prefecture, Japan, Postal Code 034–0093, Phone +81-716-23-5121, FAX +81-176-23-2999.
Results
Patient characteristics and univariate analysis
A total of 411 individuals (112 with MCI and 299 with AD) were found as candidates for the participants. After excluding individuals with MMSE < 20, we included 240 participants. There were 112 participants with MCI (68 women and 44 men; median age = 77.5 years) and 128 participants with early AD (89 women and 39 men; median age = 78 years).
According to a report by the Ministry of Health, Labor and Welfare, an estimated 4 million people had MCI, and 3.12 million people had AD (4.62 million with dementia) in the general population of Japan in 2012. From these data, the ratio of AD to MCI was found to be 43.8:56.2 [33]. On the other hand, in our study, the proportions of AD and MCI were 53.3% and 46.7%, respectively. The sample size for comparing the ratio of one group with the known ratio was N = 237 when calculated with a statistical power of (1-β) = 0.8 and α = 0.05. Our study included 240 participants and was considered to meet the required sample size.
The demographic and clinical data of the participants are shown in Table 1. As a result of the univariate analysis with the Benjamini-Hochberg procedure, there were no statistically significant differences in the sex distribution, age, education year or eZIS ratio between participants with MCI and those with early AD. There were statistically significant differences in the MMSE scores, VSRAD VOI severity, VSRAD VOI extent, VSRAD GM extent, VSRAD ratio, eZIS severity and eZIS extent of the MCI and early AD groups.
Table 1. Demographic and clinical data for participants.
Factor | MCI | AD | p-value | Adjusted p-value |
---|---|---|---|---|
Participants: N | 112 | 128 | ||
Women: N (%) | 68 (60.7) | 89 (69.5) | 0.174 | 0.21 |
Men: N (%) | 44 (39.3) | 39 (30.5) | ||
Age: mean (SD) | 77.47 (6.11) | 78.28 (5.88) | 0.298 | 0.33 |
Education year: mean (SD) | 10.88 (2.42) | 10.80 (2.62) | 0.791 | 0.791 |
MMSE: mean (SD) | 25.93 (2.38) | 22.84 (2.05) | <0.001 | <0.05 |
eZIS extent: mean (SD) | 11.78 (8.97) | 15.20 (10.30) | 0.007 | <0.05 |
eZIS ratio: mean (SD) | 2.11 (1.53) | 2.47 (1.47) | 0.066 | 0.09 |
eZIS severity: mean (SD) | 1.16 (0.31) | 1.29 (0.35) | 0.002 | <0.05 |
VSRAD GM extent: mean (SD) | 3.69 (1.98) | 4.94 (2.74) | <0.001 | <0.05 |
VSRAD VOI extent: mean (SD) | 14.19 (21.34) | 34.71 (30.68) | <0.001 | <0.05 |
VSRAD ratio: mean (SD) | 3.55 (4.69) | 7.18 (6.53) | <0.001 | <0.05 |
VSRAD VOI severity: mean (SD) | 1.16 (0.79) | 1.88 (1.07) | <0.001 | <0.05 |
Abbreviations in Table 1: mild cognitive impairment, MCI; Alzheimer’s disease, AD; Voxel-based Specific Regional Analysis System for Alzheimer’s Disease, VSRAD; volume of interest, VOI; gray matter atrophy in the whole brain, GM; easy Z-score imaging system, eZIS; standard deviation, SD.
An adjusted p-value <0.05 was regarded as significant using the Benjamini-Hochberg procedure due to multiple testing.
Binomial logistic regression analyses
First, a forward-backward stepwise binomial logistic regression analysis (stepwise selection model) based on AIC was performed with MCI and early AD as the dependent variables. Statistically significant factors in the univariate analysis (MMSE score, VSRAD VOI severity, VSRAD VOI extent, VSRAD GM extent, VSRAD ratio, eZIS severity and eZIS extent) were used as independent variables for stepwise binomial logistic regression analysis. As a result of this analysis, we found that a lower MMSE score (odds ratio = 0.561; p < 0.001), higher VSRAD VOI extent (odds ratio = 1.025; p < 0.001) and higher eZIS extent (OR 1.039; p = 0.033) were associated with early AD.
The equation for the new scores derived from the stepwise binomial logistic regression analysis for MCI and early AD screening was as follows:
Pr (case) = 1/ (1+exp (-(13.1272+0.0244*(VSRAD VOI extent) +0.0387*(eZIS extent)-0.5777*MMSE))). These results are described in Table 2.
Table 2. Results of the binomial logistic regression analyses.
B | SE | Wald | OR (95% CI) | P-value | |
---|---|---|---|---|---|
Stepwise selection model | |||||
Intercept | 13.127 | ||||
MMSE | -0.578 | 0.086 | 45.056 | 0.561 (0.474–0.664) | <0.001 |
VSRAD VOI extent | 0.024 | 0.007 | 13.124 | 1.025 (1.011–1.038) | <0.001 |
eZIS extent | 0.039 | 0.018 | 4.573 | 1.039 (1.003–1.077) | 0.033 |
Abbreviations in Table 2: Mini-Mental State Examination, MMSE; Voxel-based Specific Regional Analysis System for Alzheimer’s Disease, VSRAD; volume of interest, VOI; easy Z-score imaging system, eZIS; regression coefficient, B; standard error, SE; odds ratio, OR; confidence interval, CI.
Receiver operating characteristic (ROC) curve analysis
Table 3 shows the results of the ROC curve analysis for the discrimination between MCI and early AD. The AUC using MMSE scores alone was 0.835. On the other hand, the AUC obtained from the stepwise selection model that combined MMSE, VSRAD VOI extent and eZIS extent was 0.870. A chi-square test of these AUCs revealed that the stepwise selection model had a statistically significantly larger area than the MMSE score alone (p = 0.012). The results of the ROC analysis are described in Table 3 and Fig 1.
Table 3. Results of the receiver operating characteristic curve analyses.
Cutoff point | FPF | TPF | AUC (95% CI) | SE | |
---|---|---|---|---|---|
MMSE | 23 | 0.143 | 0.695 | 0.835 (0.784–0.886) | 0.026 |
VSRAD VOI severity | 1.35 | 0.250 | 0.625 | 0.710 (0.645–0.775) | 0.033 |
VSRAD VOI extent | 33.54 | 0.125 | 0.492 | 0.708 (0.643–0.773) | 0.033 |
VSRAD GM extent | 3.51 | 0.402 | 0.703 | 0.649 (0.579–0.719) | 0.036 |
VSRAD ratio | 5.66 | 0.223 | 0.531 | 0.677 (0.610–0.745) | 0.034 |
eZIS severity | 1.3 | 0.250 | 0.469 | 0.616 (0.544–0.687) | 0.036 |
eZIS extent | 13.8 | 0.277 | 0.500 | 0.607 (0.536–0.679) | 0.037 |
eZIS ratio | 1.8 | 0.438 | 0.617 | 0.581 (0.580–0.654) | 0.037 |
Stepwise selection model | 0.517 | 0.179 | 0.828 | 0.870 (0.824–0.916) | 0.023 |
Abbreviations in Table 3: Mini-Mental State Examination, MMSE; Voxel-based Specific Regional Analysis System for Alzheimer’s Disease, VSRAD; volume of interest, VOI; gray matter atrophy in the whole brain, GM; easy Z-score imaging system, eZIS; regression coefficient, false positive fraction, FPF; true positive fraction, TPF; area under the curve, AUC; standard error, SE.
Fig 1. Receiver operating characteristic (ROC) curve analyses.
The results of the ROC analysis for the discrimination between MCI and early AD. The area under the ROC curve (AUC) using MMSE scores alone was 0.835. On the other hand, the AUC obtained from the stepwise selection model that combined MMSE, VSRAD VOI extent and eZIS extent was 0.870. A chi-square test of these AUCs revealed that the stepwise selection model had a statistically significantly larger area than the MMSE score alone (p = 0.012).)
Discussion
Our study revealed that the diagnostic accuracy that distinguished MCI from early AD was statistically significantly improved by combining quantitative data from psychological tests with brain morphological and functional image analyses. The AUC with the MMSE scores alone was 0.835, but the AUC was improved to 0.870 by adding the VSRAD VOI extent and eZIS extent to the MMSE scores. VSRAD and eZIS are useful applications that automatically quantify cerebral atrophy and blood flow decreases based on the data obtained from MRI and SPECT, so physicians may improve the diagnostic accuracy of dementia regardless of clinical experience.
For these applications, “VSRAD VOI severity” and “eZIS severity” are the most representative indicators. However, interestingly, the factors selected in the stepwise selection model were “VSRAD VOI extent” and “eZIS extent”.
According to Braak staging [34, 35], which explains the pathological changes in AD, the burden of tau protein spreads as the stage progresses. In addition, gray matter loss in the medial temporal lobe has already been recognized in MCI, and it is known that the loss area expands at conversion to AD [36]. Mizumura et al stated that studying the “extent” of the region of abnormal blood flow that causes functional disorder is more rational than assessing the “severity” of the blood flow abnormality that reflects local tissue degeneration [37]. Their discussion is confirmed by the results of our study. Therefore, on brain MRI and SPECT, the "extent" of the lesion may be more important for distinguishing MCI from AD than the "severity" of local atrophy and decreased regional cerebral blood flow.
In our study, we compared participants with MCI and those with early AD, but VSRAD and eZIS had lower AUCs for each indicator than previous studies comparing healthy volunteers with early AD [20, 38]. MCI may have some findings that are similar to those of early AD, so there may have been relatively poor discrimination accuracy for discriminating MCI from early AD.
There are several assessment tools for dementia, but it is not fully understood which combinations work better. A previous study on positron emission tomography (PET) and MRI stated that it was important to combine modalities to assess AD from different perspectives [39]. Another study reported that the diagnostic accuracy of dementia was improved by combining two different neuropsychological tests: the MMSE and the clock-drawing test [40]. Here, we have shown that the combination of a neuropsychological test with a brain imaging evaluation, based on logistic regression analysis, improves the diagnostic accuracy of discriminating MCI from early AD in a statistically significant manner compared with the use of each test alone.
When predicting diagnostic accuracy by combining multiple different indicators, it is important to select statistically significant indicators and weight them according to the multivariate analysis results. In our study, we included a sufficient number of patients, which was more than 10 times the number of independent variables [41]. For this reason, we could identify statistically significant independent variables not only by univariate correlation analysis but also by binomial logistic regression analysis.
Previous studies have reported inadequate diagnostic accuracy for dementia in primary care settings [42]. That is, the diagnosis of early AD may be delayed and may lead to underestimation of cognitive impairment [42]. In Japan, the number of dementia patients will exceed 6 million in 2020 due to the rapid aging of the population [43]. In addition, previous research estimated that the social cost of dementia in Japan will have reached approximately 14.5 trillion yen per year in 2014 [44]. It is known that early diagnosis of dementia and appropriate intervention not only improve the quality of life of patients and their families but also reduce socioeconomic costs [45]. Therefore, we also considered it important from the viewpoint of public health to combine psychological tests and quantitative brain imaging data to improve the accuracy and reproducibility of dementia diagnoses.
As imaging modalities evolve and examination costs decrease, it is expected that the number of diagnostic support tools will increase. Among brain imaging assessment tools, PET is a useful biomarker as are MRI and SPECT [39]; however, the use of PET for the detection of dementia has not yet been accepted for reimbursement in the National Health Insurance system in Japan. Hence, MRI and SPECT are widely applied to patients with cognitive impairment in Japan [46]. New biomarkers for the diagnosis of AD, including the measurement of cerebrospinal fluid β-amyloid 42 and tau proteins [47], are being clinically applied. It is necessary to continue conducting research on better test combinations that take cost performance and insurance adaptation into account.
Our study has several limitations. Our research was a single-center, retrospective, cross-sectional study. It can explain the diagnostic accuracy of the test, but the causal relationship between the results and the disease remains unknown. In addition, our study did not randomize the patient population, which may lead to sampling bias. In our study, the sample size was appropriate, and the statistical power was also sufficient. Although the odds ratio of the independent variable in logistic regression analysis was statistically significant, the effect size was limited. Furthermore, although the site and extent of atrophy differ based on the subtypes of AD [48], heterogeneity in the AD population may have been high because our study did not identify these subtypes. Importantly, in 2011, the National Institute on Aging and Alzheimer’s Association created separate diagnostic recommendations for the preclinical, MCI, and dementia stages of AD (the NIA-AA guidelines), and the guidelines were updated in 2018 [49]. The research framework focuses on the diagnosis of AD with biomarkers grouped into those of β amyloid deposition, pathologic tau, and neurodegeneration in living persons [49]. We did not evaluate these biomarkers of AD in our study. As a result, it was not possible to accurately assess cognitive impairment and pathological abnormalities in AD based on the NIA-AA guidelines, which is a novel definition of AD continuum staging using biomarkers [49].
It is also possible that the population of MCI subjects may contain not only MCI due to AD but also MCI due to another cognitive impairment (e.g., dementia with Lewy body or frontotemporal dementia). Our research has limitations in terms of population heterogeneity. In addition, there are other psychological tests used to evaluate cognitive function in addition to the MMSE; however, we did not include them in the statistical analysis because they had some missing values, and the listwise method did not provide a sufficient sample size. Further research on the combination of other psychological and imaging tests is needed.
Conclusions
We found that combining the MMSE score with two indicators from automated quantitative assessment applications using brain MRI and SPECT, known as VSRAD and eZIS, respectively, significantly improved the accuracy of discrimination between MCI and early AD compared with the MMSE score alone. Implementing VSRAD and eZIS does not require professional clinical experience in the treatment of dementia. Therefore, the accuracy of dementia diagnosis by physicians may be easily improved in real-world primary care settings.
Acknowledgments
We gratefully acknowledge Mr. Terue Urushihata for his work with psychological testing. We would like to thank all medical staff of Towada City Hospital for their kind support.
Data Availability
The ethics committee of Towada City Hospital has set restrictions on data sharing because the data contain potentially identifying or sensitive patient information. Please contact the institutional review board of the ethics committee of Towada City Hospital for data requests. Upon request, the ethics committee will decide whether to share the data. Contact information for our ethics committee: The institutional review board of the ethics committee of Towada City Hospital (Chairperson of the ethics committee: Dr. Masaru Kudo); Towanda City, Nishi 12-14-8, Aomori Prefecture, Japan, Postal Code 034-450 0093, Phone +81-716-23-5121, FAX +81-176-23-2999.
Funding Statement
The authors received no specific funding for this work.
References
- 1.Mayeux R, Stern Y. Epidemiology of Alzheimer disease. Cold Spring Harbor perspectives in medicine. 2012;2(8). Epub 2012/08/22. 10.1101/cshperspect.a006239 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Reitz C, Brayne C, Mayeux R. Epidemiology of Alzheimer disease. Nature reviews Neurology. 2011;7(3):137–52. Epub 2011/02/10. 10.1038/nrneurol.2011.2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Sachdev PS, Blacker D, Blazer DG, Ganguli M, Jeste DV, Paulsen JS, et al. Classifying neurocognitive disorders: the DSM-5 approach. Nature reviews Neurology. 2014;10(11):634–42. Epub 2014/10/01. 10.1038/nrneurol.2014.181 . [DOI] [PubMed] [Google Scholar]
- 4.Gauthier S, Reisberg B, Zaudig M, Petersen RC, Ritchie K, Broich K, et al. Mild cognitive impairment. Lancet (London, England). 2006;367(9518):1262–70. Epub 2006/04/25. 10.1016/s0140-6736(06)68542-5 . [DOI] [PubMed] [Google Scholar]
- 5.Malek-Ahmadi M. Reversion From Mild Cognitive Impairment to Normal Cognition: A Meta-Analysis. Alzheimer disease and associated disorders. 2016;30(4):324–30. Epub 2016/02/26. 10.1097/WAD.0000000000000145 . [DOI] [PubMed] [Google Scholar]
- 6.Shimada H, Makizako H, Doi T, Lee S, Lee S. Conversion and Reversion Rates in Japanese Older People With Mild Cognitive Impairment. Journal of the American Medical Directors Association. 2017;18(9):808.e1–.e6. Epub 2017/07/18. 10.1016/j.jamda.2017.05.017 . [DOI] [PubMed] [Google Scholar]
- 7.Petersen RC, Roberts RO, Knopman DS, Boeve BF, Geda YE, Ivnik RJ, et al. Mild cognitive impairment: ten years later. Archives of neurology. 2009;66(12):1447–55. Epub 2009/12/17. 10.1001/archneurol.2009.266 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Petersen RC, Doody R, Kurz A, Mohs RC, Morris JC, Rabins PV, et al. Current concepts in mild cognitive impairment. Archives of neurology. 2001;58(12):1985–92. Epub 2001/12/26. 10.1001/archneur.58.12.1985 . [DOI] [PubMed] [Google Scholar]
- 9.Petersen RC, Smith GE, Waring SC, Ivnik RJ, Tangalos EG, Kokmen E. Mild cognitive impairment: clinical characterization and outcome. Archives of neurology. 1999;56(3):303–8. Epub 1999/04/06. 10.1001/archneur.56.3.303 . [DOI] [PubMed] [Google Scholar]
- 10.Tombaugh TN, McIntyre NJ. The mini-mental state examination: a comprehensive review. Journal of the American Geriatrics Society. 1992;40(9):922–35. Epub 1992/09/01. 10.1111/j.1532-5415.1992.tb01992.x . [DOI] [PubMed] [Google Scholar]
- 11.Mitchell AJ. A meta-analysis of the accuracy of the mini-mental state examination in the detection of dementia and mild cognitive impairment. Journal of psychiatric research. 2009;43(4):411–31. Epub 2008/06/27. 10.1016/j.jpsychires.2008.04.014 . [DOI] [PubMed] [Google Scholar]
- 12.Li X, Shimizu S, Jibiki I, Watanabe K, Kubota T. Correlations between Z-scores of VSRAD and regional cerebral blood flow of SPECT in patients with Alzheimer’s disease and mild cognitive impairment. Psychiatry and clinical neurosciences. 2010;64(3):284–92. Epub 2010/04/09. 10.1111/j.1440-1819.2010.02076.x . [DOI] [PubMed] [Google Scholar]
- 13.Mosconi L, Tsui WH, Herholz K, Pupi A, Drzezga A, Lucignani G, et al. Multicenter standardized 18F-FDG PET diagnosis of mild cognitive impairment, Alzheimer’s disease, and other dementias. Journal of nuclear medicine: official publication, Society of Nuclear Medicine. 2008;49(3):390–8. Epub 2008/02/22. 10.2967/jnumed.107.045385 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Hirata Y, Matsuda H, Nemoto K, Ohnishi T, Hirao K, Yamashita F, et al. Voxel-based morphometry to discriminate early Alzheimer’s disease from controls. Neuroscience letters. 2005;382(3):269–74. Epub 2005/06/01. 10.1016/j.neulet.2005.03.038 . [DOI] [PubMed] [Google Scholar]
- 15.Matsuda H, Mizumura S, Nemoto K, Yamashita F, Imabayashi E, Sato N, et al. Automatic voxel-based morphometry of structural MRI by SPM8 plus diffeomorphic anatomic registration through exponentiated lie algebra improves the diagnosis of probable Alzheimer Disease. AJNR American journal of neuroradiology. 2012;33(6):1109–14. Epub 2012/02/04. 10.3174/ajnr.A2935 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Matsuda H. Voxel-based Morphometry of Brain MRI in Normal Aging and Alzheimer’s Disease. Aging and disease. 2013;4(1):29–37. Epub 2013/02/21. [PMC free article] [PubMed] [Google Scholar]
- 17.Li F, Takechi H, Saito R, Ayaki T, Kokuryu A, Kuzuya A, et al. A comparative study: visual rating scores and the voxel-based specific regional analysis system for Alzheimer’s disease on magnetic resonance imaging among subjects with Alzheimer’s disease, mild cognitive impairment, and normal cognition. Psychogeriatrics: the official journal of the Japanese Psychogeriatric Society. 2019;19(2):95–104. Epub 2018/10/03. 10.1111/psyg.12370 . [DOI] [PubMed] [Google Scholar]
- 18.Oshikubo G, Akahane A, Unno A, Watanabe Y, Ikebuchi E, Tochigi M, et al. Utility of VSRAD for diagnosing Alzheimer’s disease in patients screened for dementia. The Journal of international medical research. 2020;48(4):300060520917270 Epub 2020/04/18. 10.1177/0300060520917270 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Kogure D, Matsuda H, Ohnishi T, Asada T, Uno M, Kunihiro T, et al. Longitudinal evaluation of early Alzheimer’s disease using brain perfusion SPECT. Journal of nuclear medicine: official publication, Society of Nuclear Medicine. 2000;41(7):1155–62. Epub 2000/07/29. . [PubMed] [Google Scholar]
- 20.Matsuda H, Mizumura S, Nagao T, Ota T, Iizuka T, Nemoto K, et al. Automated discrimination between very early Alzheimer disease and controls using an easy Z-score imaging system for multicenter brain perfusion single-photon emission tomography. AJNR American journal of neuroradiology. 2007;28(4):731–6. Epub 2007/04/10. . [PMC free article] [PubMed] [Google Scholar]
- 21.Kanetaka H, Matsuda H, Asada T, Ohnishi T, Yamashita F, Imabayashi E, et al. Effects of partial volume correction on discrimination between very early Alzheimer’s dementia and controls using brain perfusion SPECT. European journal of nuclear medicine and molecular imaging. 2004;31(7):975–80. Epub 2004/03/03. 10.1007/s00259-004-1491-3 . [DOI] [PubMed] [Google Scholar]
- 22.Folstein MF, Folstein SE, McHugh PR. "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. Journal of psychiatric research. 1975;12(3):189–98. Epub 1975/11/01. 10.1016/0022-3956(75)90026-6 . [DOI] [PubMed] [Google Scholar]
- 23.Kato S. Development of the revised version of Hasegawa’s Dementia Scale (HDS-R). Jpn Geriatr Psychiatr Med. 1991;2:1339–47. [Google Scholar]
- 24.Shulman KI. Clock-drawing: is it the ideal cognitive screening test? International journal of geriatric psychiatry. 2000;15(6):548–61. Epub 2000/06/22. . [DOI] [PubMed] [Google Scholar]
- 25.Kohs SC. Intelligence measurement: A psychological and statistical study based upon the block-design tests: Macmillan; 1923. [Google Scholar]
- 26.Benton AL. A visual retention test for clinical use. Archives of neurology and psychiatry. 1945;54:212–6. Epub 1945/09/01. 10.1001/archneurpsyc.1945.02300090051008 . [DOI] [PubMed] [Google Scholar]
- 27.Petersen RC, Smith GE, Waring SC, Ivnik RJ, Tangalos EG, Kokmen E. Mild cognitive impairment: clinical characterization and outcome. Archives of neurology. 1999;56(3):303–8. 10.1001/archneur.56.3.303 [DOI] [PubMed] [Google Scholar]
- 28.Wattmo C, Minthon L, Wallin Å K. Mild versus moderate stages of Alzheimer’s disease: three-year outcomes in a routine clinical setting of cholinesterase inhibitor therapy. Alzheimer’s research & therapy. 2016;8:7 Epub 2016/02/18. 10.1186/s13195-016-0174-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Matsuda H. MRI morphometry in Alzheimer’s disease. Ageing Res Rev. 2016;30:17–24. Epub 2016/01/27. 10.1016/j.arr.2016.01.003 . [DOI] [PubMed] [Google Scholar]
- 30.Matsuda H, Yokoyama K, Sato N, Ito K, Nemoto K, Oba H, et al. Differentiation Between Dementia With Lewy Bodies And Alzheimer’s Disease Using Voxel-Based Morphometry Of Structural MRI: A Multicenter Study. Neuropsychiatric disease and treatment. 2019;15:2715–22. Epub 2019/10/02. 10.2147/NDT.S222966 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Kaneta T, Nakatsuka M, Nakamura K, Seki T, Yamaguchi S, Tsuboi M, et al. Improved Diagnostic Accuracy of SPECT Through Statistical Analysis and the Detection of Hot Spots at the Primary Sensorimotor Area for the Diagnosis of Alzheimer Disease in a Community-Based Study: "The Osaki-Tajiri Project". Clinical nuclear medicine. 2016;41(1):e1–6. Epub 2015/09/12. 10.1097/RLU.0000000000000976 . [DOI] [PubMed] [Google Scholar]
- 32.Kanda Y. Investigation of the freely available easy-to-use software ‘EZR’for medical statistics. Bone marrow transplantation. 2013;48(3):452–8. 10.1038/bmt.2012.244 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Ministry of Health, Labour and Welfare. Comprehensive promotion of measures for dementia. 2020. Available from: https://www.mhlw.go.jp/content/12300000/000519620.pdf.
- 34.Braak H, Alafuzoff I, Arzberger T, Kretzschmar H, Del Tredici K. Staging of Alzheimer disease-associated neurofibrillary pathology using paraffin sections and immunocytochemistry. Acta neuropathologica. 2006;112(4):389–404. 10.1007/s00401-006-0127-z [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Braak H, Braak E. Staging of Alzheimer’s disease-related neurofibrillary changes. Neurobiology of aging. 1995;16(3):271–8. 10.1016/0197-4580(95)00021-6 [DOI] [PubMed] [Google Scholar]
- 36.Karas GB, Scheltens P, Rombouts SA, Visser PJ, van Schijndel RA, Fox NC, et al. Global and local gray matter loss in mild cognitive impairment and Alzheimer’s disease. NeuroImage. 2004;23(2):708–16. Epub 2004/10/19. 10.1016/j.neuroimage.2004.07.006 . [DOI] [PubMed] [Google Scholar]
- 37.Mizumura S, Kumita S, Cho K, Ishihara M, Nakajo H, Toba M, et al. Development of quantitative analysis method for stereotactic brain image: assessment of reduced accumulation in extent and severity using anatomical segmentation. Annals of nuclear medicine. 2003;17(4):289–95. Epub 2003/08/23. 10.1007/BF02988523 . [DOI] [PubMed] [Google Scholar]
- 38.Sone D, Imabayashi E, Maikusa N, Ogawa M, Sato N, Matsuda H. Voxel-based Specific Regional Analysis System for Alzheimer’s Disease (VSRAD) on 3-tesla Normal Database: Diagnostic Accuracy in Two Independent Cohorts with Early Alzheimer’s Disease. Aging and disease. 2018;9(4):755–60. Epub 2018/08/10. 10.14336/AD.2017.0818 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Dukart J, Kherif F, Mueller K, Adaszewski S, Schroeter ML, Frackowiak RS, et al. Generative FDG-PET and MRI model of aging and disease progression in Alzheimer’s disease. PLoS computational biology. 2013;9(4):e1002987 Epub 2013/04/18. 10.1371/journal.pcbi.1002987 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Cacho J, Benito-Leon J, Garcia-Garcia R, Fernandez-Calvo B, Vicente-Villardon JL, Mitchell AJ. Does the combination of the MMSE and clock drawing test (mini-clock) improve the detection of mild Alzheimer’s disease and mild cognitive impairment? Journal of Alzheimer’s disease: JAD. 2010;22(3):889–96. Epub 2010/09/23. 10.3233/JAD-2010-101182 . [DOI] [PubMed] [Google Scholar]
- 41.Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. Journal of clinical epidemiology. 1996;49(12):1373–9. Epub 1996/12/01. 10.1016/s0895-4356(96)00236-3 . [DOI] [PubMed] [Google Scholar]
- 42.Valcour VG, Masaki KH, Curb JD, Blanchette PL. The detection of dementia in the primary care setting. Archives of internal medicine. 2000;160(19):2964–8. 10.1001/archinte.160.19.2964 [DOI] [PubMed] [Google Scholar]
- 43.Ministry of Health LaW. Measures against dementia, https://www.mhlw.go.jp/stf/seisakunitsuite/bunya/hukushi_kaigo/kaigo_koureisha/ninchi/index.html.
- 44.Sado M, Ninomiya A, Shikimoto R, Ikeda B, Baba T, Yoshimura K, et al. The estimated cost of dementia in Japan, the most aged society in the world. PloS one. 2018;13(11):e0206508 Epub 2018/11/13. 10.1371/journal.pone.0206508 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Leifer BP. Early diagnosis of Alzheimer’s disease: clinical and economic benefits. Journal of the American Geriatrics Society. 2003;51(5s2):S281–S8. 10.1046/j.1532-5415.5153.x [DOI] [PubMed] [Google Scholar]
- 46.Matsuda H. Role of neuroimaging in Alzheimer’s disease, with emphasis on brain perfusion SPECT. Journal of nuclear medicine: official publication, Society of Nuclear Medicine. 2007;48(8):1289–300. Epub 2007/07/17. 10.2967/jnumed.106.037218 . [DOI] [PubMed] [Google Scholar]
- 47.Tapiola T, Alafuzoff I, Herukka S-K, Parkkinen L, Hartikainen P, Soininen H, et al. Cerebrospinal Fluid β-Amyloid 42 and Tau Proteins as Biomarkers of Alzheimer-Type Pathologic Changes in the Brain. Archives of neurology. 2009;66(3):382–9. 10.1001/archneurol.2008.596 [DOI] [PubMed] [Google Scholar]
- 48.Whitwell JL, Dickson DW, Murray ME, Weigand SD, Tosakulwong N, Senjem ML, et al. Neuroimaging correlates of pathologically defined subtypes of Alzheimer’s disease: a case-control study. The Lancet Neurology. 2012;11(10):868–77. Epub 2012/09/07. 10.1016/S1474-4422(12)70200-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Jack CR Jr., Bennett DA, Blennow K, Carrillo MC, Dunn B, Haeberlein SB, et al. NIA-AA Research Framework: Toward a biological definition of Alzheimer’s disease. Alzheimer’s & dementia: the journal of the Alzheimer’s Association. 2018;14(4):535–62. Epub 2018/04/15. 10.1016/j.jalz.2018.02.018 [DOI] [PMC free article] [PubMed] [Google Scholar]