Skip to main content
PLOS One logoLink to PLOS One
. 2021 Feb 22;16(2):e0247427. doi: 10.1371/journal.pone.0247427

The combination of MMSE with VSRAD and eZIS has greater accuracy for discriminating mild cognitive impairment from early Alzheimer’s disease than MMSE alone

Keita Tokumitsu 1,2, Norio Yasui-Furukori 2,*, Junko Takeuchi 1, Koji Yachimori 1, Norio Sugawara 2, Yoshio Terayama 3, Nobuyuki Tanaka 3, Tatsunori Naraoka 3, Kazutaka Shimoda 2
Editor: Stephen D Ginsberg4
PMCID: PMC7899318  PMID: 33617587

Abstract

Background

Alzheimer’s disease (AD) is assessed by carefully examining a patient’s cognitive impairment. However, previous studies reported inadequate diagnostic accuracy for dementia in primary care settings. Many hospitals use the automated quantitative evaluation method known as the Voxel-based Specific Regional Analysis System for Alzheimer’s Disease (VSRAD), wherein brain MRI data are used to evaluate brain morphological abnormalities associated with AD. Similarly, an automated quantitative evaluation application called the easy Z-score imaging system (eZIS), which uses brain SPECT data to detect regional cerebral blood flow decreases associated with AD, is widely used. These applications have several indicators, each of which is known to correlate with the degree of AD. However, it is not completely known whether these indicators work better when used in combination in real-world clinical practice.

Methods

We included 112 participants with mild cognitive impairment (MCI) and 128 participants with early AD in this study. All participants underwent MRI, SPECT, and the Mini-Mental State Examination (MMSE). Demographic and clinical characteristics were assessed by univariate analysis, and logistic regression analysis with a combination of MMSE, VSRAD and eZIS indicators was performed to verify whether the diagnostic accuracy in discriminating between MCI and early AD was improved.

Results

The area under the receiver operating characteristic curve (AUC) for the MMSE score alone was 0.835. The AUC was significantly improved to 0.870 by combining the MMSE score with two quantitative indicators from the VSRAD and eZIS that assessed the extent of brain abnormalities.

Conclusion

Compared with the MMSE score alone, the combination of the MMSE score with the VSRAD and eZIS indicators significantly improves the accuracy of discrimination between patients with MCI and early AD. Implementing VSRAD and eZIS does not require professional clinical experience in the treatment of dementia. Therefore, the accuracy of dementia diagnosis by physicians may easily be improved in real-world primary care settings.

Introduction

Dementia is an important disease characterized by progressive cognitive impairment and social dysfunction [1]. In particular, Alzheimer’s disease (AD) accounts for approximately 70% of dementia cases [2] and often occurs in patients in their 70s and 80s. Additionally, the prevalence increases exponentially with aging [2]. The diagnosis of dementia is assessed by carefully examining a patient’s cognitive impairment and function in daily life according to international diagnostic criteria such as the International Statistical Classification of Diseases and Related Health Problems 10th edition (ICD-10) and the Diagnostic and Statistical Manual of Mental Disorders 5th edition (DSM-5) [3]. More than half of patients with mild cognitive impairment (MCI) progress to dementia within 5 years, but some MCI patients may remain MCI stable or return to normal cognition over time [46]. For this reason, accurate discrimination between MCI and early AD is important [4, 7, 8], especially when considering therapeutic interventions and the prognosis of dementia [4, 8, 9].

However, due to the rapid increase in the number of patients, diagnosis and treatment are not always performed by doctors who have clinical experienced with dementia. Therefore, the Mini-Mental State Examination (MMSE) is being developed as a screening tool to assist in the diagnosis of dementia [10]. This tool is a simple test consisting of questions asked by an evaluator and is often used in primary care settings. A recent meta-analysis reported that the MMSE has a sensitivity of 78.4% and a specificity of 87.8% in distinguishing between AD and MCI in primary care settings [11].

However, it is difficult to exclude cerebral organic diseases with only the MMSE, and the accuracy of this examination in distinguishing MCI from AD is inferior to the diagnostic accuracy of a specialist [11]. Therefore, it is necessary to try to improve the accuracy by combining it with other assessment methods.

At this point, brain imaging analyses are useful in the differential diagnosis of dementia and are often used in a qualitative manner to exclude organic disorders such as stroke, brain tumors, normal pressure hydrocephalus, and encephalitis. Recently, the performance of brain imaging analyses has improved, and the quantitative analysis of brain morphology and function has become possible, making it a powerful auxiliary tool for dementia diagnosis [12, 13].

It has been reported that medial temporal lobe atrophy is a characteristic morphological change in AD. The automated quantitative evaluation application called the Voxel-based Specific Regional Analysis System for Alzheimer’s Disease (VSRAD), which uses brain magnetic resonance imaging (MRI) data to assess the brain morphological abnormalities associated with AD, was developed by Dr. Matsuda and colleagues [14, 15]. VSRAD applies voxel-based morphometry (VBM), which is a method for superimposing plane tomographic images from head MRI and dividing the entire brain into small cubes for statistical analysis [16]. This free software application was updated into VSRAD advance 2 in May 2015, and it is being used in many hospitals. In particular, a Z-score of gray matter atrophy in the volume of interest (VOI) relevant to AD, which measures the severity of medial temporal atrophy, is a representative indicator of VSRAD [15, 17, 18].

Furthermore, characteristic cerebral blood flow decreases in the parietal lobe and posterior cingulate gyrus associated with AD can be assessed by single photon emission computed tomography (SPECT) [19]. An automated quantitative evaluation application called the easy Z-score imaging system (eZIS), which uses brain SPECT data to detect the regional cerebral blood flow decrease in AD, is widely used in Japan [20]. “Severity”, which is one of the quantitative indicators displayed as the Z-score for regional blood flow decrease, is regarded as the most representative eZIS [21].

The VSRAD and eZIS applications have indicators, and each indicator has been reported to correlate with cognitive decline independently [12]. However, previous studies have the limitation of a small sample size, and it is not completely known whether these indicators work better in combination in real-world clinical practice. To address this clinical question, it is necessary to perform multivariate analysis. Hence, we performed a binomial logistic regression analysis combining MMSE scores and VSRAD and eZIS indicators to verify whether the diagnostic accuracy for discriminating between MCI and early AD was improved.

Materials and methods

We recruited MCI and early AD participants from the outpatient department of Towada City Hospital between September 2016 and March 2020. All participants underwent MRI, SPECT, and a battery of laboratory tests, including assessment of thyroid function and vitamin B12, folate and serum ammonia concentrations. Cognitive function was assessed with the MMSE [22], the Revised Hasegawa’s Dementia Scale (HDS-R) [23], the clock-drawing test (CDT) [24], Kohs block design test [25], and Benton visual retention test [26]. A diagnosis of AD was made based on the DSM-5 and ICD-10. A diagnosis of MCI was made according to Petersen’s criteria [27]. We included patients in our study with MMSE scores of 20 or higher to exclude moderate to severe dementia [28]. The exclusion criteria were symptoms of depression, dementia with Lewy bodies, cerebrovascular disease, or any other psychiatric disorder.

MRI procedure

MRI was performed on a 1.5T system (GE Signa Explore, General Electric Co, Boston, USA). Axial, coronal and sagittal T1-weighted sequence (SE) images (repetition time [TR], 520 ms; echo time [TE], 12.0 ms; 5-mm slice thickness) and axial T2-weighted SE images (TR, 3800 ms; TE, 97.0 ms) were obtained for diagnosis. Then, 3D volumetric acquisition of a T1-weighted gradient-echo sequence produced a gapless series of thin sagittal sections using a magnetization-prepared rapid-acquisition gradient-echo sequence (TR, 12.3 ms; TE, 5.1 ms; flip angle, 15°; acquisition matrix, 256 × 256; 1.4-mm slice thickness).

Voxel-based Specific Regional Analysis System for Alzheimer Disease (VSRAD)

The voxel-based analysis system in the present study has been validated [14]. Currently, the software is distributed in Japan under the name Voxel-based Specific Regional Analysis System for Alzheimer Disease advance 2 (VSRAD advance 2, Eisai Co, Tokyo, Japan). In VSRAD advance 2, the DARTEL (diffeomorphic anatomical registration through exponentiated Lie algebra) and SPM8 (Statistical Parametric Mapping 8, Institute of Neurology, London, UK) divide the T1-weighted brain MRI into cerebrospinal fluid, gray matter and white matter, and then, anatomical standardization is performed. Normalized patient data are smoothed with a Gaussian kernel of 8-mm full width at half maximum, and the degree of brain atrophy is assessed for each voxel [29].

VSRAD scores reflect the severity of gray matter loss across the entire brain because the software compares an image with the original normal database template. VSRAD advance 2 automatically calculates the four indicators of AD shown below:

  1. the Z-score of gray matter atrophy severity in the volume of interest of AD (“VSRAD VOI severity”) = ((normal control average of voxel level–patient’s voxel level)/normal control standard deviation),

  2. the extent of gray matter atrophy in the VOI of AD (“VSRAD VOI extent”) = ((number of voxels judged to have a Z-score of more than 2/number of all voxels in the volume of the hippocampus) × 100%),

  3. The extent of gray matter atrophy in the whole brain (“VSRAD GM extent”) = a percentage of voxels with a Z-score >2 compared with the whole brain, and

  4. the ratio of the extent of gray matter atrophy in the VOI to the whole brain (“VSRAD VOI ratio”) = ((number of voxels judged to have a Z-score of more than 2/number of all voxels in the volume of the whole brain) × 100%).

These four indicators of VSRAD have been explained in previous reports [15, 30].

SPECT procedure

The patient received a bolus injection of 99mTc-ethyl cysteinate dimer (ECD) (600 MBq, Fujifilm Toyama Chemical Co, Tokyo, Japan) via the right brachial vein in a comfortable supine position with eyes closed, while awake in quiet surroundings. Twenty minutes after angiography, SPECT images were obtained using a rotating, two-head gamma camera (GE Infinia, General Electric Co, Boston, USA) with low energy high resolution and parallel hole collimators (128 × 128 matrix). The images were reconstructed using Butterworth and ramp filters, and attenuation correction was performed according to Chang’s method.

The easy Z-score imaging system (eZIS)

The eZIS calculates the degree of decrease in cerebral blood flow in each voxel after anatomical standardization of the patient’s brain SPECT data by SPM2 (Statistical Parametric Mapping 2, Wellcome Department of Cognitive Neurology, London, UK).

The images are spatially normalized to an original template by using SPM2, and then, images are smoothed with a Gaussian kernel, 12 mm in full width at half maximum [21].

Subsequently, a voxel-based analysis is performed using a Z-score map calculated through a comparison of a patient’s data with a control database after voxel normalization to global mean cerebral blood flow, Z-score = ([control mean] − [individual value])/(control SD).

The eZIS automatically calculates the following three indicators for characterizing regional cerebral blood flow (rCBF):

  1. The severity of rCBF decrease in a specific region showing rCBF reduction from the averaged positive Z-score in the voxels of interest (bilateral posterior cingulate cortices [PCC], precunei, and parietal cortices) (“eZIS severity”),

  2. The extent of a significant regional rCBF reduction in the voxel of interest by calculating the percentage of coordinates with a Z-value exceeding the threshold value of 2 (“eZIS extent”), and

  3. The ratio of the extent of a region showing significant rCBF reduction in the voxel of interest to the extent of a region showing significant rCBF reduction in the whole brain, which is also the percentage of coordinates with a Z-value exceeding the threshold value of 2 (“eZIS ratio”); this ratio indicates the specificity of the rCBF reduction in the voxel of interest compared with that in the whole brain.

These three indicators of eZIS have been explained in previous reports [20, 31].

Statistical analysis

All statistical analyses were performed with EZR (Saitama Medical Center, Jichi Medical University, Saitama, Japan) [32], which is a graphical user interface for R (The R Foundation for Statistical Computing, Vienna, Austria, version 3.5.2). More precisely, it is a modified version of the R commander that was designed to add statistical functions frequently used in biostatistics.

First, all statistical tests were based on a two-sided significance level of p < 0.05. Demographic and clinical characteristics were analyzed using the chi-square test and Mann–Whitney U test for differences between MCI and early AD patients. For multiple univariate analysis, the Benjamini-Hochberg procedure was used to determine whether each p-value was statistically significant.

Second, a forward-backward stepwise binomial logistic regression analysis based on Akaike’s information criterion (AIC) was performed. MCI or early AD were included in the analysis as dependent variables, and sex, age, education year, MMSE score, VSRAD VOI severity, VSRAD VOI extent, VSRAD GM extent, VSRAD ratio, eZIS severity, eZIS extent and eZIS ratio were used as candidate independent variables. Factors showing significant differences in the univariate analysis were included in the model by the stepwise method. The result of this calculation was named the "stepwise selection model".

Third, receiver operating characteristic (ROC) curve and area under the ROC curve (AUC) analyses for discrimination between MCI and early AD were performed for each VSRAD indicator, each eZIS indicator, and the stepwise selection model. A diagnosis based on the DSM-5 and ICD-10 by psychiatrists certified by the Japanese Society of Psychiatry and Neurology was used as the gold standard.

Ethics

This study was conducted in accordance with the Declaration of Helsinki and the Japanese Ethical Guidelines for Medical and Health Research Involving Human Subjects. Prior to the initiation of the study, the study protocol was reviewed and approved by the institutional review board of the ethics committee of Towada City Hospital (No. 1–4, Approved 12 June 2020). Since this was a retrospective medical record survey, informed consent was exempted, but we instead released information on this research so that patients were free to opt out.

A contact information for our ethics committee: The institutional review board of the ethics committee of Towada City Hospital (Chairperson of the ethics committee: Dr. Masaru Kudo); Towanda City, Nishi 12-14-8, Aomori Prefecture, Japan, Postal Code 034–0093, Phone +81-716-23-5121, FAX +81-176-23-2999.

Results

Patient characteristics and univariate analysis

A total of 411 individuals (112 with MCI and 299 with AD) were found as candidates for the participants. After excluding individuals with MMSE < 20, we included 240 participants. There were 112 participants with MCI (68 women and 44 men; median age = 77.5 years) and 128 participants with early AD (89 women and 39 men; median age = 78 years).

According to a report by the Ministry of Health, Labor and Welfare, an estimated 4 million people had MCI, and 3.12 million people had AD (4.62 million with dementia) in the general population of Japan in 2012. From these data, the ratio of AD to MCI was found to be 43.8:56.2 [33]. On the other hand, in our study, the proportions of AD and MCI were 53.3% and 46.7%, respectively. The sample size for comparing the ratio of one group with the known ratio was N = 237 when calculated with a statistical power of (1-β) = 0.8 and α = 0.05. Our study included 240 participants and was considered to meet the required sample size.

The demographic and clinical data of the participants are shown in Table 1. As a result of the univariate analysis with the Benjamini-Hochberg procedure, there were no statistically significant differences in the sex distribution, age, education year or eZIS ratio between participants with MCI and those with early AD. There were statistically significant differences in the MMSE scores, VSRAD VOI severity, VSRAD VOI extent, VSRAD GM extent, VSRAD ratio, eZIS severity and eZIS extent of the MCI and early AD groups.

Table 1. Demographic and clinical data for participants.

Factor MCI AD p-value Adjusted p-value
Participants: N 112 128
Women: N (%) 68 (60.7) 89 (69.5) 0.174 0.21
Men: N (%) 44 (39.3) 39 (30.5)
Age: mean (SD) 77.47 (6.11) 78.28 (5.88) 0.298 0.33
Education year: mean (SD) 10.88 (2.42) 10.80 (2.62) 0.791 0.791
MMSE: mean (SD) 25.93 (2.38) 22.84 (2.05) <0.001 <0.05
eZIS extent: mean (SD) 11.78 (8.97) 15.20 (10.30) 0.007 <0.05
eZIS ratio: mean (SD) 2.11 (1.53) 2.47 (1.47) 0.066 0.09
eZIS severity: mean (SD) 1.16 (0.31) 1.29 (0.35) 0.002 <0.05
VSRAD GM extent: mean (SD) 3.69 (1.98) 4.94 (2.74) <0.001 <0.05
VSRAD VOI extent: mean (SD) 14.19 (21.34) 34.71 (30.68) <0.001 <0.05
VSRAD ratio: mean (SD) 3.55 (4.69) 7.18 (6.53) <0.001 <0.05
VSRAD VOI severity: mean (SD) 1.16 (0.79) 1.88 (1.07) <0.001 <0.05

Abbreviations in Table 1: mild cognitive impairment, MCI; Alzheimer’s disease, AD; Voxel-based Specific Regional Analysis System for Alzheimer’s Disease, VSRAD; volume of interest, VOI; gray matter atrophy in the whole brain, GM; easy Z-score imaging system, eZIS; standard deviation, SD.

An adjusted p-value <0.05 was regarded as significant using the Benjamini-Hochberg procedure due to multiple testing.

Binomial logistic regression analyses

First, a forward-backward stepwise binomial logistic regression analysis (stepwise selection model) based on AIC was performed with MCI and early AD as the dependent variables. Statistically significant factors in the univariate analysis (MMSE score, VSRAD VOI severity, VSRAD VOI extent, VSRAD GM extent, VSRAD ratio, eZIS severity and eZIS extent) were used as independent variables for stepwise binomial logistic regression analysis. As a result of this analysis, we found that a lower MMSE score (odds ratio = 0.561; p < 0.001), higher VSRAD VOI extent (odds ratio = 1.025; p < 0.001) and higher eZIS extent (OR 1.039; p = 0.033) were associated with early AD.

The equation for the new scores derived from the stepwise binomial logistic regression analysis for MCI and early AD screening was as follows:

Pr (case) = 1/ (1+exp (-(13.1272+0.0244*(VSRAD VOI extent) +0.0387*(eZIS extent)-0.5777*MMSE))). These results are described in Table 2.

Table 2. Results of the binomial logistic regression analyses.

B SE Wald OR (95% CI) P-value
Stepwise selection model
Intercept 13.127
MMSE -0.578 0.086 45.056 0.561 (0.474–0.664) <0.001
VSRAD VOI extent 0.024 0.007 13.124 1.025 (1.011–1.038) <0.001
eZIS extent 0.039 0.018 4.573 1.039 (1.003–1.077) 0.033

Abbreviations in Table 2: Mini-Mental State Examination, MMSE; Voxel-based Specific Regional Analysis System for Alzheimer’s Disease, VSRAD; volume of interest, VOI; easy Z-score imaging system, eZIS; regression coefficient, B; standard error, SE; odds ratio, OR; confidence interval, CI.

Receiver operating characteristic (ROC) curve analysis

Table 3 shows the results of the ROC curve analysis for the discrimination between MCI and early AD. The AUC using MMSE scores alone was 0.835. On the other hand, the AUC obtained from the stepwise selection model that combined MMSE, VSRAD VOI extent and eZIS extent was 0.870. A chi-square test of these AUCs revealed that the stepwise selection model had a statistically significantly larger area than the MMSE score alone (p = 0.012). The results of the ROC analysis are described in Table 3 and Fig 1.

Table 3. Results of the receiver operating characteristic curve analyses.

Cutoff point FPF TPF AUC (95% CI) SE
MMSE 23 0.143 0.695 0.835 (0.784–0.886) 0.026
VSRAD VOI severity 1.35 0.250 0.625 0.710 (0.645–0.775) 0.033
VSRAD VOI extent 33.54 0.125 0.492 0.708 (0.643–0.773) 0.033
VSRAD GM extent 3.51 0.402 0.703 0.649 (0.579–0.719) 0.036
VSRAD ratio 5.66 0.223 0.531 0.677 (0.610–0.745) 0.034
eZIS severity 1.3 0.250 0.469 0.616 (0.544–0.687) 0.036
eZIS extent 13.8 0.277 0.500 0.607 (0.536–0.679) 0.037
eZIS ratio 1.8 0.438 0.617 0.581 (0.580–0.654) 0.037
Stepwise selection model 0.517 0.179 0.828 0.870 (0.824–0.916) 0.023

Abbreviations in Table 3: Mini-Mental State Examination, MMSE; Voxel-based Specific Regional Analysis System for Alzheimer’s Disease, VSRAD; volume of interest, VOI; gray matter atrophy in the whole brain, GM; easy Z-score imaging system, eZIS; regression coefficient, false positive fraction, FPF; true positive fraction, TPF; area under the curve, AUC; standard error, SE.

Fig 1. Receiver operating characteristic (ROC) curve analyses.

Fig 1

The results of the ROC analysis for the discrimination between MCI and early AD. The area under the ROC curve (AUC) using MMSE scores alone was 0.835. On the other hand, the AUC obtained from the stepwise selection model that combined MMSE, VSRAD VOI extent and eZIS extent was 0.870. A chi-square test of these AUCs revealed that the stepwise selection model had a statistically significantly larger area than the MMSE score alone (p = 0.012).)

Discussion

Our study revealed that the diagnostic accuracy that distinguished MCI from early AD was statistically significantly improved by combining quantitative data from psychological tests with brain morphological and functional image analyses. The AUC with the MMSE scores alone was 0.835, but the AUC was improved to 0.870 by adding the VSRAD VOI extent and eZIS extent to the MMSE scores. VSRAD and eZIS are useful applications that automatically quantify cerebral atrophy and blood flow decreases based on the data obtained from MRI and SPECT, so physicians may improve the diagnostic accuracy of dementia regardless of clinical experience.

For these applications, “VSRAD VOI severity” and “eZIS severity” are the most representative indicators. However, interestingly, the factors selected in the stepwise selection model were “VSRAD VOI extent” and “eZIS extent”.

According to Braak staging [34, 35], which explains the pathological changes in AD, the burden of tau protein spreads as the stage progresses. In addition, gray matter loss in the medial temporal lobe has already been recognized in MCI, and it is known that the loss area expands at conversion to AD [36]. Mizumura et al stated that studying the “extent” of the region of abnormal blood flow that causes functional disorder is more rational than assessing the “severity” of the blood flow abnormality that reflects local tissue degeneration [37]. Their discussion is confirmed by the results of our study. Therefore, on brain MRI and SPECT, the "extent" of the lesion may be more important for distinguishing MCI from AD than the "severity" of local atrophy and decreased regional cerebral blood flow.

In our study, we compared participants with MCI and those with early AD, but VSRAD and eZIS had lower AUCs for each indicator than previous studies comparing healthy volunteers with early AD [20, 38]. MCI may have some findings that are similar to those of early AD, so there may have been relatively poor discrimination accuracy for discriminating MCI from early AD.

There are several assessment tools for dementia, but it is not fully understood which combinations work better. A previous study on positron emission tomography (PET) and MRI stated that it was important to combine modalities to assess AD from different perspectives [39]. Another study reported that the diagnostic accuracy of dementia was improved by combining two different neuropsychological tests: the MMSE and the clock-drawing test [40]. Here, we have shown that the combination of a neuropsychological test with a brain imaging evaluation, based on logistic regression analysis, improves the diagnostic accuracy of discriminating MCI from early AD in a statistically significant manner compared with the use of each test alone.

When predicting diagnostic accuracy by combining multiple different indicators, it is important to select statistically significant indicators and weight them according to the multivariate analysis results. In our study, we included a sufficient number of patients, which was more than 10 times the number of independent variables [41]. For this reason, we could identify statistically significant independent variables not only by univariate correlation analysis but also by binomial logistic regression analysis.

Previous studies have reported inadequate diagnostic accuracy for dementia in primary care settings [42]. That is, the diagnosis of early AD may be delayed and may lead to underestimation of cognitive impairment [42]. In Japan, the number of dementia patients will exceed 6 million in 2020 due to the rapid aging of the population [43]. In addition, previous research estimated that the social cost of dementia in Japan will have reached approximately 14.5 trillion yen per year in 2014 [44]. It is known that early diagnosis of dementia and appropriate intervention not only improve the quality of life of patients and their families but also reduce socioeconomic costs [45]. Therefore, we also considered it important from the viewpoint of public health to combine psychological tests and quantitative brain imaging data to improve the accuracy and reproducibility of dementia diagnoses.

As imaging modalities evolve and examination costs decrease, it is expected that the number of diagnostic support tools will increase. Among brain imaging assessment tools, PET is a useful biomarker as are MRI and SPECT [39]; however, the use of PET for the detection of dementia has not yet been accepted for reimbursement in the National Health Insurance system in Japan. Hence, MRI and SPECT are widely applied to patients with cognitive impairment in Japan [46]. New biomarkers for the diagnosis of AD, including the measurement of cerebrospinal fluid β-amyloid 42 and tau proteins [47], are being clinically applied. It is necessary to continue conducting research on better test combinations that take cost performance and insurance adaptation into account.

Our study has several limitations. Our research was a single-center, retrospective, cross-sectional study. It can explain the diagnostic accuracy of the test, but the causal relationship between the results and the disease remains unknown. In addition, our study did not randomize the patient population, which may lead to sampling bias. In our study, the sample size was appropriate, and the statistical power was also sufficient. Although the odds ratio of the independent variable in logistic regression analysis was statistically significant, the effect size was limited. Furthermore, although the site and extent of atrophy differ based on the subtypes of AD [48], heterogeneity in the AD population may have been high because our study did not identify these subtypes. Importantly, in 2011, the National Institute on Aging and Alzheimer’s Association created separate diagnostic recommendations for the preclinical, MCI, and dementia stages of AD (the NIA-AA guidelines), and the guidelines were updated in 2018 [49]. The research framework focuses on the diagnosis of AD with biomarkers grouped into those of β amyloid deposition, pathologic tau, and neurodegeneration in living persons [49]. We did not evaluate these biomarkers of AD in our study. As a result, it was not possible to accurately assess cognitive impairment and pathological abnormalities in AD based on the NIA-AA guidelines, which is a novel definition of AD continuum staging using biomarkers [49].

It is also possible that the population of MCI subjects may contain not only MCI due to AD but also MCI due to another cognitive impairment (e.g., dementia with Lewy body or frontotemporal dementia). Our research has limitations in terms of population heterogeneity. In addition, there are other psychological tests used to evaluate cognitive function in addition to the MMSE; however, we did not include them in the statistical analysis because they had some missing values, and the listwise method did not provide a sufficient sample size. Further research on the combination of other psychological and imaging tests is needed.

Conclusions

We found that combining the MMSE score with two indicators from automated quantitative assessment applications using brain MRI and SPECT, known as VSRAD and eZIS, respectively, significantly improved the accuracy of discrimination between MCI and early AD compared with the MMSE score alone. Implementing VSRAD and eZIS does not require professional clinical experience in the treatment of dementia. Therefore, the accuracy of dementia diagnosis by physicians may be easily improved in real-world primary care settings.

Acknowledgments

We gratefully acknowledge Mr. Terue Urushihata for his work with psychological testing. We would like to thank all medical staff of Towada City Hospital for their kind support.

Data Availability

The ethics committee of Towada City Hospital has set restrictions on data sharing because the data contain potentially identifying or sensitive patient information. Please contact the institutional review board of the ethics committee of Towada City Hospital for data requests. Upon request, the ethics committee will decide whether to share the data. Contact information for our ethics committee: The institutional review board of the ethics committee of Towada City Hospital (Chairperson of the ethics committee: Dr. Masaru Kudo); Towanda City, Nishi 12-14-8, Aomori Prefecture, Japan, Postal Code 034-450 0093, Phone +81-716-23-5121, FAX +81-176-23-2999.

Funding Statement

The authors received no specific funding for this work.

References

  • 1.Mayeux R, Stern Y. Epidemiology of Alzheimer disease. Cold Spring Harbor perspectives in medicine. 2012;2(8). Epub 2012/08/22. 10.1101/cshperspect.a006239 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Reitz C, Brayne C, Mayeux R. Epidemiology of Alzheimer disease. Nature reviews Neurology. 2011;7(3):137–52. Epub 2011/02/10. 10.1038/nrneurol.2011.2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Sachdev PS, Blacker D, Blazer DG, Ganguli M, Jeste DV, Paulsen JS, et al. Classifying neurocognitive disorders: the DSM-5 approach. Nature reviews Neurology. 2014;10(11):634–42. Epub 2014/10/01. 10.1038/nrneurol.2014.181 . [DOI] [PubMed] [Google Scholar]
  • 4.Gauthier S, Reisberg B, Zaudig M, Petersen RC, Ritchie K, Broich K, et al. Mild cognitive impairment. Lancet (London, England). 2006;367(9518):1262–70. Epub 2006/04/25. 10.1016/s0140-6736(06)68542-5 . [DOI] [PubMed] [Google Scholar]
  • 5.Malek-Ahmadi M. Reversion From Mild Cognitive Impairment to Normal Cognition: A Meta-Analysis. Alzheimer disease and associated disorders. 2016;30(4):324–30. Epub 2016/02/26. 10.1097/WAD.0000000000000145 . [DOI] [PubMed] [Google Scholar]
  • 6.Shimada H, Makizako H, Doi T, Lee S, Lee S. Conversion and Reversion Rates in Japanese Older People With Mild Cognitive Impairment. Journal of the American Medical Directors Association. 2017;18(9):808.e1–.e6. Epub 2017/07/18. 10.1016/j.jamda.2017.05.017 . [DOI] [PubMed] [Google Scholar]
  • 7.Petersen RC, Roberts RO, Knopman DS, Boeve BF, Geda YE, Ivnik RJ, et al. Mild cognitive impairment: ten years later. Archives of neurology. 2009;66(12):1447–55. Epub 2009/12/17. 10.1001/archneurol.2009.266 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Petersen RC, Doody R, Kurz A, Mohs RC, Morris JC, Rabins PV, et al. Current concepts in mild cognitive impairment. Archives of neurology. 2001;58(12):1985–92. Epub 2001/12/26. 10.1001/archneur.58.12.1985 . [DOI] [PubMed] [Google Scholar]
  • 9.Petersen RC, Smith GE, Waring SC, Ivnik RJ, Tangalos EG, Kokmen E. Mild cognitive impairment: clinical characterization and outcome. Archives of neurology. 1999;56(3):303–8. Epub 1999/04/06. 10.1001/archneur.56.3.303 . [DOI] [PubMed] [Google Scholar]
  • 10.Tombaugh TN, McIntyre NJ. The mini-mental state examination: a comprehensive review. Journal of the American Geriatrics Society. 1992;40(9):922–35. Epub 1992/09/01. 10.1111/j.1532-5415.1992.tb01992.x . [DOI] [PubMed] [Google Scholar]
  • 11.Mitchell AJ. A meta-analysis of the accuracy of the mini-mental state examination in the detection of dementia and mild cognitive impairment. Journal of psychiatric research. 2009;43(4):411–31. Epub 2008/06/27. 10.1016/j.jpsychires.2008.04.014 . [DOI] [PubMed] [Google Scholar]
  • 12.Li X, Shimizu S, Jibiki I, Watanabe K, Kubota T. Correlations between Z-scores of VSRAD and regional cerebral blood flow of SPECT in patients with Alzheimer’s disease and mild cognitive impairment. Psychiatry and clinical neurosciences. 2010;64(3):284–92. Epub 2010/04/09. 10.1111/j.1440-1819.2010.02076.x . [DOI] [PubMed] [Google Scholar]
  • 13.Mosconi L, Tsui WH, Herholz K, Pupi A, Drzezga A, Lucignani G, et al. Multicenter standardized 18F-FDG PET diagnosis of mild cognitive impairment, Alzheimer’s disease, and other dementias. Journal of nuclear medicine: official publication, Society of Nuclear Medicine. 2008;49(3):390–8. Epub 2008/02/22. 10.2967/jnumed.107.045385 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Hirata Y, Matsuda H, Nemoto K, Ohnishi T, Hirao K, Yamashita F, et al. Voxel-based morphometry to discriminate early Alzheimer’s disease from controls. Neuroscience letters. 2005;382(3):269–74. Epub 2005/06/01. 10.1016/j.neulet.2005.03.038 . [DOI] [PubMed] [Google Scholar]
  • 15.Matsuda H, Mizumura S, Nemoto K, Yamashita F, Imabayashi E, Sato N, et al. Automatic voxel-based morphometry of structural MRI by SPM8 plus diffeomorphic anatomic registration through exponentiated lie algebra improves the diagnosis of probable Alzheimer Disease. AJNR American journal of neuroradiology. 2012;33(6):1109–14. Epub 2012/02/04. 10.3174/ajnr.A2935 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Matsuda H. Voxel-based Morphometry of Brain MRI in Normal Aging and Alzheimer’s Disease. Aging and disease. 2013;4(1):29–37. Epub 2013/02/21. [PMC free article] [PubMed] [Google Scholar]
  • 17.Li F, Takechi H, Saito R, Ayaki T, Kokuryu A, Kuzuya A, et al. A comparative study: visual rating scores and the voxel-based specific regional analysis system for Alzheimer’s disease on magnetic resonance imaging among subjects with Alzheimer’s disease, mild cognitive impairment, and normal cognition. Psychogeriatrics: the official journal of the Japanese Psychogeriatric Society. 2019;19(2):95–104. Epub 2018/10/03. 10.1111/psyg.12370 . [DOI] [PubMed] [Google Scholar]
  • 18.Oshikubo G, Akahane A, Unno A, Watanabe Y, Ikebuchi E, Tochigi M, et al. Utility of VSRAD for diagnosing Alzheimer’s disease in patients screened for dementia. The Journal of international medical research. 2020;48(4):300060520917270 Epub 2020/04/18. 10.1177/0300060520917270 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Kogure D, Matsuda H, Ohnishi T, Asada T, Uno M, Kunihiro T, et al. Longitudinal evaluation of early Alzheimer’s disease using brain perfusion SPECT. Journal of nuclear medicine: official publication, Society of Nuclear Medicine. 2000;41(7):1155–62. Epub 2000/07/29. . [PubMed] [Google Scholar]
  • 20.Matsuda H, Mizumura S, Nagao T, Ota T, Iizuka T, Nemoto K, et al. Automated discrimination between very early Alzheimer disease and controls using an easy Z-score imaging system for multicenter brain perfusion single-photon emission tomography. AJNR American journal of neuroradiology. 2007;28(4):731–6. Epub 2007/04/10. . [PMC free article] [PubMed] [Google Scholar]
  • 21.Kanetaka H, Matsuda H, Asada T, Ohnishi T, Yamashita F, Imabayashi E, et al. Effects of partial volume correction on discrimination between very early Alzheimer’s dementia and controls using brain perfusion SPECT. European journal of nuclear medicine and molecular imaging. 2004;31(7):975–80. Epub 2004/03/03. 10.1007/s00259-004-1491-3 . [DOI] [PubMed] [Google Scholar]
  • 22.Folstein MF, Folstein SE, McHugh PR. "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. Journal of psychiatric research. 1975;12(3):189–98. Epub 1975/11/01. 10.1016/0022-3956(75)90026-6 . [DOI] [PubMed] [Google Scholar]
  • 23.Kato S. Development of the revised version of Hasegawa’s Dementia Scale (HDS-R). Jpn Geriatr Psychiatr Med. 1991;2:1339–47. [Google Scholar]
  • 24.Shulman KI. Clock-drawing: is it the ideal cognitive screening test? International journal of geriatric psychiatry. 2000;15(6):548–61. Epub 2000/06/22. . [DOI] [PubMed] [Google Scholar]
  • 25.Kohs SC. Intelligence measurement: A psychological and statistical study based upon the block-design tests: Macmillan; 1923. [Google Scholar]
  • 26.Benton AL. A visual retention test for clinical use. Archives of neurology and psychiatry. 1945;54:212–6. Epub 1945/09/01. 10.1001/archneurpsyc.1945.02300090051008 . [DOI] [PubMed] [Google Scholar]
  • 27.Petersen RC, Smith GE, Waring SC, Ivnik RJ, Tangalos EG, Kokmen E. Mild cognitive impairment: clinical characterization and outcome. Archives of neurology. 1999;56(3):303–8. 10.1001/archneur.56.3.303 [DOI] [PubMed] [Google Scholar]
  • 28.Wattmo C, Minthon L, Wallin Å K. Mild versus moderate stages of Alzheimer’s disease: three-year outcomes in a routine clinical setting of cholinesterase inhibitor therapy. Alzheimer’s research & therapy. 2016;8:7 Epub 2016/02/18. 10.1186/s13195-016-0174-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Matsuda H. MRI morphometry in Alzheimer’s disease. Ageing Res Rev. 2016;30:17–24. Epub 2016/01/27. 10.1016/j.arr.2016.01.003 . [DOI] [PubMed] [Google Scholar]
  • 30.Matsuda H, Yokoyama K, Sato N, Ito K, Nemoto K, Oba H, et al. Differentiation Between Dementia With Lewy Bodies And Alzheimer’s Disease Using Voxel-Based Morphometry Of Structural MRI: A Multicenter Study. Neuropsychiatric disease and treatment. 2019;15:2715–22. Epub 2019/10/02. 10.2147/NDT.S222966 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Kaneta T, Nakatsuka M, Nakamura K, Seki T, Yamaguchi S, Tsuboi M, et al. Improved Diagnostic Accuracy of SPECT Through Statistical Analysis and the Detection of Hot Spots at the Primary Sensorimotor Area for the Diagnosis of Alzheimer Disease in a Community-Based Study: "The Osaki-Tajiri Project". Clinical nuclear medicine. 2016;41(1):e1–6. Epub 2015/09/12. 10.1097/RLU.0000000000000976 . [DOI] [PubMed] [Google Scholar]
  • 32.Kanda Y. Investigation of the freely available easy-to-use software ‘EZR’for medical statistics. Bone marrow transplantation. 2013;48(3):452–8. 10.1038/bmt.2012.244 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Ministry of Health, Labour and Welfare. Comprehensive promotion of measures for dementia. 2020. Available from: https://www.mhlw.go.jp/content/12300000/000519620.pdf.
  • 34.Braak H, Alafuzoff I, Arzberger T, Kretzschmar H, Del Tredici K. Staging of Alzheimer disease-associated neurofibrillary pathology using paraffin sections and immunocytochemistry. Acta neuropathologica. 2006;112(4):389–404. 10.1007/s00401-006-0127-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Braak H, Braak E. Staging of Alzheimer’s disease-related neurofibrillary changes. Neurobiology of aging. 1995;16(3):271–8. 10.1016/0197-4580(95)00021-6 [DOI] [PubMed] [Google Scholar]
  • 36.Karas GB, Scheltens P, Rombouts SA, Visser PJ, van Schijndel RA, Fox NC, et al. Global and local gray matter loss in mild cognitive impairment and Alzheimer’s disease. NeuroImage. 2004;23(2):708–16. Epub 2004/10/19. 10.1016/j.neuroimage.2004.07.006 . [DOI] [PubMed] [Google Scholar]
  • 37.Mizumura S, Kumita S, Cho K, Ishihara M, Nakajo H, Toba M, et al. Development of quantitative analysis method for stereotactic brain image: assessment of reduced accumulation in extent and severity using anatomical segmentation. Annals of nuclear medicine. 2003;17(4):289–95. Epub 2003/08/23. 10.1007/BF02988523 . [DOI] [PubMed] [Google Scholar]
  • 38.Sone D, Imabayashi E, Maikusa N, Ogawa M, Sato N, Matsuda H. Voxel-based Specific Regional Analysis System for Alzheimer’s Disease (VSRAD) on 3-tesla Normal Database: Diagnostic Accuracy in Two Independent Cohorts with Early Alzheimer’s Disease. Aging and disease. 2018;9(4):755–60. Epub 2018/08/10. 10.14336/AD.2017.0818 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Dukart J, Kherif F, Mueller K, Adaszewski S, Schroeter ML, Frackowiak RS, et al. Generative FDG-PET and MRI model of aging and disease progression in Alzheimer’s disease. PLoS computational biology. 2013;9(4):e1002987 Epub 2013/04/18. 10.1371/journal.pcbi.1002987 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Cacho J, Benito-Leon J, Garcia-Garcia R, Fernandez-Calvo B, Vicente-Villardon JL, Mitchell AJ. Does the combination of the MMSE and clock drawing test (mini-clock) improve the detection of mild Alzheimer’s disease and mild cognitive impairment? Journal of Alzheimer’s disease: JAD. 2010;22(3):889–96. Epub 2010/09/23. 10.3233/JAD-2010-101182 . [DOI] [PubMed] [Google Scholar]
  • 41.Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. Journal of clinical epidemiology. 1996;49(12):1373–9. Epub 1996/12/01. 10.1016/s0895-4356(96)00236-3 . [DOI] [PubMed] [Google Scholar]
  • 42.Valcour VG, Masaki KH, Curb JD, Blanchette PL. The detection of dementia in the primary care setting. Archives of internal medicine. 2000;160(19):2964–8. 10.1001/archinte.160.19.2964 [DOI] [PubMed] [Google Scholar]
  • 43.Ministry of Health LaW. Measures against dementia, https://www.mhlw.go.jp/stf/seisakunitsuite/bunya/hukushi_kaigo/kaigo_koureisha/ninchi/index.html.
  • 44.Sado M, Ninomiya A, Shikimoto R, Ikeda B, Baba T, Yoshimura K, et al. The estimated cost of dementia in Japan, the most aged society in the world. PloS one. 2018;13(11):e0206508 Epub 2018/11/13. 10.1371/journal.pone.0206508 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Leifer BP. Early diagnosis of Alzheimer’s disease: clinical and economic benefits. Journal of the American Geriatrics Society. 2003;51(5s2):S281–S8. 10.1046/j.1532-5415.5153.x [DOI] [PubMed] [Google Scholar]
  • 46.Matsuda H. Role of neuroimaging in Alzheimer’s disease, with emphasis on brain perfusion SPECT. Journal of nuclear medicine: official publication, Society of Nuclear Medicine. 2007;48(8):1289–300. Epub 2007/07/17. 10.2967/jnumed.106.037218 . [DOI] [PubMed] [Google Scholar]
  • 47.Tapiola T, Alafuzoff I, Herukka S-K, Parkkinen L, Hartikainen P, Soininen H, et al. Cerebrospinal Fluid β-Amyloid 42 and Tau Proteins as Biomarkers of Alzheimer-Type Pathologic Changes in the Brain. Archives of neurology. 2009;66(3):382–9. 10.1001/archneurol.2008.596 [DOI] [PubMed] [Google Scholar]
  • 48.Whitwell JL, Dickson DW, Murray ME, Weigand SD, Tosakulwong N, Senjem ML, et al. Neuroimaging correlates of pathologically defined subtypes of Alzheimer’s disease: a case-control study. The Lancet Neurology. 2012;11(10):868–77. Epub 2012/09/07. 10.1016/S1474-4422(12)70200-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Jack CR Jr., Bennett DA, Blennow K, Carrillo MC, Dunn B, Haeberlein SB, et al. NIA-AA Research Framework: Toward a biological definition of Alzheimer’s disease. Alzheimer’s & dementia: the journal of the Alzheimer’s Association. 2018;14(4):535–62. Epub 2018/04/15. 10.1016/j.jalz.2018.02.018 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Stephen D Ginsberg

19 Nov 2020

PONE-D-20-30261

Combining MMSE and brain MRI and SPECT indicators from the automated quantitative assessment applications VSRAD and eZIS improves accuracy of discrimination between mild cognitive impairment and early Alzheimer's disease.

PLOS ONE

Dear Dr. Yasui-Furukori,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration by 2 Reviewers and an Academic Editor, all of the critiques of both Reviewers must be addressed in detail in a revision to determine publication status. If you are prepared to undertake the work required, I would be pleased to reconsider my decision, but revision of the original submission without directly addressing the critiques of the 2 Reviewers does not guarantee acceptance for publication in PLOS ONE. If the authors do not feel that the queries can be addressed, please consider submitting to another publication medium. A revised submission will be sent out for re-review. The authors are urged to have the manuscript given a hard copyedit for syntax and grammar.

==============================

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. 

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously? 

Reviewer #1: No

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Commentary on: Combining MMSE and brain MRI and SPECT indicators from the automated quantitative assessment applications VSRAD and [the] eZIS improve [the] accuracy of discrimination between mild cognitive impairment and early Alzheimer's disease.

The authors present a retrospective, single-center, cross-sectional study that evaluates 240 MCI and early AD patients with MMSE, voxel-base morphometry (VBM), and cerebral blood flow (CBF) quantification with SPECT. VBM medial temporal atrophy and decreased CBF in the parietal lobe and posterior cingulate gyrus are used as proxies of an AD profile. The authors claim that by combining two proxies for neuronal injury (i.e. decreased brain volume and decreased CBF) and a single neuro-psychometric assessment score clinicians can acceptably differentiate between AD and MCI.

Major remarks

Only one screening tool is employed for cognitive assessment. Please explain why other and complementary neuropsychological screening tools were not used (e.g. MoCA, CDR-SB, Mattis Dementia Rating Scale).

Please briefly summarize image preprocessing steps for both VBM and SPECT imaging.

Please provide the logistic regression equations. Please state how multiple comparisons were corrected for.

For the ROC and AUC analyses, it is not clear what was used as the gold standard to classify possible AD. I would refer the authors to the work by the NIA-AA 2018 research framework to understand what the novel definitions of AD continuum staging are.

In the introduction, the authors mention that “previous studies have the limitation that the sample size is small, and it is not completely known whether these indicators work better in combination in real-world clinical practice”; the reader would expect that the authors would provide a sample calculation for each outcome measure (i.e. MMSE, VMB, and CBF) to differentiate between MCI and early AD. Plenty of literature exists for the use of MMSE; however, although there is plenty of data regarding VBM and CBF to distinguish between MCI and AD, the reader might question how adequate are the VBM and CBF AD profile proxies that the authors used.

It is not clear what are the advantages of using the forced entry model over only using the stepwise logistic regression model. The authors claim that the advantage of the forced entry model is, “the odds ratio for the indicators in the forced entry model was higher than that on the stepwise selection model. Therefore, it was suggested that the statistical impact and clinical influence of each indicator may be different”. These are not valid reasons to select a different statistical logistic regression model.

Minor remarks

Please consider using a brief and descriptive title.

Please revise and correct the manuscript for content structure.

In the introduction the authors mention the diagnostic criteria based on ICD-10 and DSM-5, which is fine; however, the NIA-AA guidelines and definitions are most often used in our field. Please review these guidelines to discuss some of the limitations that this study has based on the disease definitions used.

The authors mention that “More than half of patients with mild cognitive impairment (MCI) progress to dementia within 5 years, but some MCI patients may remain MCI stable or return to normal cognition over time [4]”. The topic of AD progression, reversion, and cognitive stable MCI patients varies depending on the type of cognitive assessment and mediating factors such as cognitive and brain reserve, which is beyond the scope of this study; however, if the authors want to present this information, more than one reference regarding the rates of progression is necessary.

Please include a review of the literature about the diagnostic accuracy of the MMSE for dementia and MCI (e.g. Cochrane Reviews).

Please clarify what the authors mean by “The severity of regional blood flow decrease is the most representative quantitative indicator in eZIS”.

What is meant by “These two applications have several indicators, each of which is known to correlate with the degree of AD [10]”?

Please include more detail about the measures of dispersion among the group descriptions in the results section.

Please provide 95% confidence intervals in the tables and in the text.

Please place the tables at the end of the manuscript.

The authors claim in the discussion section that the participants were assessed for social and emotional function, “Since cognitive function was evaluated not only for memory but also for social and emotional function, we thought patients with relatively widespread neuronal loss and decreased cerebral blood flow were more likely to progress to dementia”; however, no evidence of this is found in the text.

Final remarks

Please have a language editor revise the manuscript. The research question lacks novelty. The authors fail to provide sufficient evidence that the study has sufficient statistical power. The authors use normalized VMB and CBF measures which are technically sound but questionably underpowered. The authors only use one proxy for cognitive impairment, which is a major weakness of the study design. The effect sizes in the multivariate analysis are small (i.e. OR of 0.561, 1.025, 1.039; 0.567, 1.999, 2.994) and no correction for multiple comparisons is applied, rendering some of the differences not significant.

Reviewer #2: The authors aimed to demonstrate that combining MMSE score with two automated quantitative methods VSRAD (based on brain MRI data) and eZIS (based on brain SPECT data) in differentiate between patients with MCI and early AD has a greater accuracy than MME score alone.

The topic is very interesting and it could have a clinical impact.

The paper is specific, well-structured and precise in the technical description.

The title is inherent in the purpose of the study, but too long and may not catch the reader's attention.

The aim of the study is clearly exposed and well-argued.

The methods and the statistic evaluation are described in an accurate way.

The results are complete, presented in a logically corrected sequence and they are analyzed extensively in the discussion. Moreover, the authors underline the applicative value of the results in real-world.

Tables and graphics show adequate drafting modalities, sufficient length, layout and size.

Bibliographic references are appropriate and consistent.

The manuscript needs the following revisions:

• Title: it is preferable to review it, reducing its length and making it more captivating.

• Results: (Patient characteristics) the lines 248-256 could be reduced to a single introductory sentence of Table 1, which is already explanatory and complete with all data.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Jaime Daniel Mondragon

Reviewer #2: No

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

==============================

Please submit your revised manuscript by May 2021. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Stephen D. Ginsberg, Ph.D.

Section Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

3. Thank you for stating the following in the Competing Interests section:

"Norio Yasui-Furukori has been a speaker for Dainippon-Sumitomo Pharmaceutical, Mochida Pharmaceutical, and MSD. Kazutaka Shimoda has received research support from Meiji Seika Pharma Co., Pfizer Inc., Dainippon Sumitomo Pharma Co., Ltd., Daiichi Sankyo Co., Otsuka Pharmaceutical Co., Ltd., Astellas Pharma Inc., Novartis Pharma K.K., Eisai Co., Ltd., Takeda Pharmaceutical Co., Ltd. and honoraria from Mitsubishi Tanabe Pharma Corporation, Meiji Seika Pharma Co., Ltd., Dainippon Sumitomo Pharma Co., Ltd., Takeda Pharmaceutical Co., Shionogi & Co., Ltd., Daiichi Sankyo Co., Pfizer Inc. and Eisai Co., Ltd. The companies had no role in the study design, the data collection and analysis, the decision to publish, or the preparation of the manuscript. The remaining authors declare that they have no competing interests to report.".

i) Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests). If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

ii) Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

4. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

5. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please delete it from any other section.

PLoS One. 2021 Feb 22;16(2):e0247427. doi: 10.1371/journal.pone.0247427.r002

Author response to Decision Letter 0


17 Jan 2021

Author’s response to the reviewers:

We are grateful to the reviewers for their critical comments and useful suggestions, which have helped us improve our paper. As indicated in the responses that follow, we have taken all these comments and suggestions into account in the revised version of our paper.

We hope that the revised version of our paper is now suitable for publication in PLOS ONE.

Sincerely,

Norio Yasui-Furukori, MD, PhD

PONE-D-20-30261

“The combination of MMSE with VSRAD and eZIS has greater accuracy for discriminating mild cognitive impairment from early Alzheimer’s disease than MMSE alone.” (We revised title based on review comments)

Reviewer #1:

Comment:

Major remarks

Only one screening tool is employed for cognitive assessment. Please explain why other and complementary neuropsychological screening tools were not used (e.g. MoCA, CDR-SB, Mattis Dementia Rating Scale).

Response:

Thank you for your important observation. Regarding the screening tool for cognitive function, in addition to the MMSE, other tests including the HDS-R, CDT, Kohs block design test, and Benton visual retention test were carried out by clinical psychologists. This missing information was added, and the manuscript was revised.

(Revised Manuscript with Track Changes: Lines 135-138.)

Comment:

Please briefly summarize image preprocessing steps for both VBM and SPECT imaging.

Response:

In VSRAD advance 2, the DARTEL (diffeomorphic anatomical registration through exponentiated Lie algebra) and SPM8 (Statistical Parametric Mapping 8, Institute of Neurology, London, UK) divide the T1-weighted brain MRI into cerebrospinal fluid, gray matter and white matter, and then, anatomical standardization is performed. Normalized patient data are smoothed with a Gaussian kernel of 8-mm full width at half maximum, and the degree of brain atrophy is assessed for each voxel.

On the other hand, the eZIS calculates the degree of decrease in cerebral blood flow in each voxel after anatomical standardization of the patient's brain SPECT data by SPM2 (Statistical Parametric Mapping 2, Wellcome Department of Cognitive Neurology, London, UK).

The images are spatially normalized by using SPM2 to an original template, then images are smoothed with a Gaussian kernel, 12 mm in full width at half maximum, and a voxel-based analysis is performed.

We revised the manuscript according to the reviewer’s comments.

(Revised Manuscript with Track Changes: Lines 160-166, 195-200.)

Comment:

Please provide the logistic regression equations. Please state how multiple comparisons were corrected for.

Response:

The equation for the new scores derived from the stepwise binomial logistic regression analysis for MCI and early AD screening was as follows:

Pr (case) = 1/ (1+exp (-(13.1272+0.0244*(VSRAD VOI extent) +0.0387*(eZIS extent)-0.5777*MMSE))). In the multiple univariate analyses shown in Table 1, the Benjamini-Hochberg procedure was used to correct the multiple comparisons. We added adjusted p-value in Table 1. On the other hand, the data obtained from logistic regression analysis did not need to be modified because the logit model itself shows the corrected odds ratio. However, repeating the tests with different logit models increases the likelihood of type I errors. Based on the reviewer’s comment, the analysis result with the forced entry model was deleted, so we thought that it is not necessary to revise the result of the binomial logistic regression analysis by the stepwise model again.

(Revised Manuscript with Track Changes: Lines 229-231,311-312, 324-327 and Table 1.)

Comment:

For the ROC and AUC analyses, it is not clear what was used as the gold standard to classify possible AD. I would refer the authors to the work by the NIA-AA 2018 research framework to understand what the novel definitions of AD continuum staging are.

Response:

Thank you for your suggestions. In our research, a diagnosis based on the DSM-5 and ICD-10 by psychiatrists certified by the Japanese Society of Psychiatry and Neurology was used as the gold standard. On the other hand, we referred to the NIA-AA 2018 research framework and described the limitations of our research.

(Revised Manuscript with Track Changes: Lines 247-249, 457-469.)

Comment:

In the introduction, the authors mention that “previous studies have the limitation that the sample size is small, and it is not completely known whether these indicators work better in combination in real-world clinical practice”; the reader would expect that the authors would provide a sample calculation for each outcome measure (i.e. MMSE, VMB, and CBF) to differentiate between MCI and early AD. Plenty of literature exists for the use of MMSE; however, although there is plenty of data regarding VBM and CBF to distinguish between MCI and AD, the reader might question how adequate are the VBM and CBF AD profile proxies that the authors used.

Response:

We appreciate your insightful comments.

According to a report by the Ministry of Health, Labor and Welfare, an estimated 4 million people had MCI, and 3.12 million people had Alzheimer's disease (4.62 million with dementia) in the general population of Japan in 2012. From these data, the ratio of AD to MCI was found to be 43.8:56.2. (https://www.mhlw.go.jp/content/12300000/000519620.pdf).

On the other hand, in our study, the proportions of AD and MCI were 53.3% and 46.7%, respectively. The sample size for comparing the ratio of one group with the known ratio was N = 237 when calculated with a statistical power of (1-β) = 0.8 and α = 0.05. Our study included 240 participants and was considered to meet the required sample size. If there is a statistically significant difference (adjusted p-value <0.05) for each result measurement using these samples, it can be determined that these indicators can distinguish between MCI and AD.

(Revised Manuscript with Track Changes: Lines 273-280.)

Comment:

It is not clear what are the advantages of using the forced entry model over only using the stepwise logistic regression model. The authors claim that the advantage of the forced entry model is, “the odds ratio for the indicators in the forced entry model was higher than that on the stepwise selection model. Therefore, it was suggested that the statistical impact and clinical influence of each indicator may be different”. These are not valid reasons to select a different statistical logistic regression model.

Response:

Thank you for your valuable feedback. As the reviewer noted, due to the lack of a valid reason for using the forced entry model in addition to the stepwise selection model, the results of the forced entry model for the binomial logistic regression analysis have been removed. We considered the reviewer's comments to be reasonable, as repeating tests with multiple models is more likely to cause type I errors.

(Revised Manuscript with Track Changes: Lines 252-230, 347-348, 350-353, 401-408. Table 2 and 3.)

Comment:

Minor remarks

Please consider using a brief and descriptive title.

Response:

According to the reviewer’s suggestion, we have shortened the title. The previous title “Combining MMSE and brain MRI and SPECT indicators from the automated quantitative assessment applications VSRAD and eZIS improves accuracy of discrimination between mild cognitive impairment and early Alzheimer's disease.” changed to "The combination of MMSE with VSRAD and eZIS has greater accuracy for discriminating mild cognitive impairment from early Alzheimer’s disease than MMSE alone".

(Revised Manuscript with Track Changes: Lines 3-5, 7-9.)

Comment:

Please revise and correct the manuscript for content structure.

Response:

The structure of the manuscript has been revised. In particular, we have increased the number of references for changes in cognitive function and removed speculative statements and results for the forced entry model for binomial logistic regression analysis. In addition, the manuscript was proofread for English language by American Journal Experts. If necessary, we will submit an editing certificate (https://www.aje.com/).

Comment:

In the introduction the authors mention the diagnostic criteria based on ICD-10 and DSM-5, which is fine; however, the NIA-AA guidelines and definitions are most often used in our field. Please review these guidelines to discuss some of the limitations that this study has based on the disease definitions used.

Response:

Thank you for introducing us to the NIA-AA guidelines. In 2011,

the National Institute on Aging and Alzheimer's Association created separate diagnostic recommendations for the preclinical, MCI, and dementia stages of AD (the NIA-AA guidelines), and the guidelines were updated in 2018. The research framework focuses on the diagnosis of AD with biomarkers grouped into those of β amyloid deposition, pathologic tau, and neurodegeneration in living persons. We did not evaluate these biomarkers of AD in our study. As a result, it was not possible to accurately assess cognitive impairment and pathological abnormalities in AD based on the NIA-AA guidelines, which is a novel definition of AD continuum staging using biomarkers.

It is also possible that the population of MCI subjects may contain not only MCI due to AD but also MCI due to another cognitive impairment (e.g., dementia with Lewy body or frontotemporal dementia).

The authors of the NIA-AA guidelines emphasized that “it is premature and inappropriate to use this research framework in general medical practice” and that “this research framework should not be used to restrict alternative approaches to hypothesis testing that do not use biomarkers”. However, we thought it is important to focus on the biological perspectives of these guidelines because our study has limitations based on population heterogeneity.

(Revised Manuscript with Track Changes: Lines 457-469.)

Comment:

The authors mention that “More than half of patients with mild cognitive impairment (MCI) progress to dementia within 5 years, but some MCI patients may remain MCI stable or return to normal cognition over time [4]”. The topic of AD progression, reversion, and cognitive stable MCI patients varies depending on the type of cognitive assessment and mediating factors such as cognitive and brain reserve, which is beyond the scope of this study; however, if the authors want to present this information, more than one reference regarding the rates of progression is necessary.

Response:

The accuracy of distinguishing between MCI and Alzheimer's disease has great influence on the explanation of prognosis and the treatment content. In particular, information about the rate of progression is essential in shared decision-making with patients. For this reason, we added the reference in the introduction section.

(Revised Manuscript with Track Changes: Line 83.)

Comment:

Please include a review of the literature about the diagnostic accuracy of the MMSE for dementia and MCI (e.g. Cochrane Reviews).

Response:

Regarding the accuracy of discrimination between AD and MCI using the MMSE in the primary care setting, the sensitivity is 78.4%, and the specificity is 87.8% according to a recent meta-analysis reported by AJ Mitchell et al.

Based on the reviewer’s comment, we added a review of the literature in the introduction section.

(Revised Manuscript with Track Changes: Lines 90-92.)

Comment:

Please clarify what the authors mean by “The severity of regional blood flow decrease is the most representative quantitative indicator in eZIS”.

Response:

Thank you for your valuable feedback. The eZIS compares the subject's cerebral blood flow data with preconfigured standard data for each voxel. Next, the eZIS program calculates the degree of cerebral blood flow hypoperfusion as the standard deviation. The absolute value of this standard deviation is defined as the "severity" of an eZIS indicator and displayed as the Z-score. The Z-score is regarded as the most representative quantitative indicator by the eZIS creator. (Kanetaka H, et al. Effects of partial volume correction on discrimination between very early Alzheimer's dementia and controls using brain perfusion SPECT. European journal of nuclear medicine and molecular imaging. 2004;31(7):975-80.)

(Revised Manuscript with Track Changes: Lines 116-122.)

Comment:

What is meant by “These two applications have several indicators, each of which is known to correlate with the degree of AD [10]”?

Response:

The VSRAD and eZIS applications have indicators including “severity”, “extent”, and “ratio”, each of which has been independently reported to correlate with cognitive decline. We have revised the sentences in our manuscript to make this easier to understand.

(Revised Manuscript with Track Changes: Lines 120-122.)

Comment:

Please include more detail about the measures of dispersion among the group descriptions in the results section.

Response:

We present the mean and SD (standard deviation) for each item as dispersion measurements in Table 1 of the Results section.

(Revised Manuscript with Track Changes: Line 310. Table 1.)

Comment:

Please provide 95% confidence intervals in the tables and in the text.

Response:

We added 95% confidence intervals for ORs in Table 2 and AUCs in Table 3.

(Revised Manuscript with Track Changes: Lines 339, 373, Table 2 and 3.)

Comment:

Please place the tables at the end of the manuscript.

Response:

Thank you for your suggestion.

PLOS ONE's submission guidelines state that "Tables should be included directly after the paragraph in which they are first cited". Therefore, please allow us to follow the journal requirements for table locations. (https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf)

Comment:

The authors claim in the discussion section that the participants were assessed for social and emotional function, “Since cognitive function was evaluated not only for memory but also for social and emotional function, we thought patients with relatively widespread neuronal loss and decreased cerebral blood flow were more likely to progress to dementia”; however, no evidence of this is found in the text.

Response:

Based on the reviewer comments, we deleted sentences that were too speculative.

(Revised Manuscript with Track Changes: Lines 398-400.)

Comment:

Final remarks

Please have a language editor revise the manuscript. The research question lacks novelty. The authors fail to provide sufficient evidence that the study has sufficient statistical power. The authors use normalized VMB and CBF measures which are technically sound but questionably underpowered. The authors only use one proxy for cognitive impairment, which is a major weakness of the study design. The effect sizes in the multivariate analysis are small (i.e., OR of 0.561, 1.025, 1.039; 0.567, 1.999, 2.994) and no correction for multiple comparisons is applied, rendering some of the differences not significant.

Response:

Thank you for your suggestion.

We asked American Journal Experts to proofread the text for English and revised the manuscript. If necessary, we will submit an editing certificate (https://www.aje.com/).

In our study, the sample size was appropriate, and the statistical power was sufficient. Although the odds ratio of the independent variable in the logistic regression analysis was statistically significant, the effect size was limited.

(Revised Manuscript with Track Changes: Lines 273-280, 452-455.)

Previous researchers reported that both indicators obtained by VSRAD and eZIS are statistically significantly correlated with the severity of cognitive impairment. For this reason, VSRAD and eZIS were effective as testing methods and auxiliary diagnostic tools for cognitive impairment. In addition, our study analyzed the most effective combinations of these indicators.

(Revised Manuscript with Track Changes: Lines120-124.)

In the past, there have been no reports indicating that the combination of specific indicators for VSRAD and eZIS with the MMSE improves diagnostic accuracy over the evaluation of the MMSE alone. For this reason, we believe that our research has a novelty.

The methods section was revised because, in fact, the patients were screened by a clinical psychologist with a test battery that combined multiple neuropsychological tests. However, neuropsychological tests other than the MMSE were not included in the statistical analysis because they had some missing values, and the listwise method did not provide a sufficient sample size. Further research is needed on the combination of neuropsychological tests other than the MMSE and eZIS and VSRAD. We have described this point as a limitation of our research.

(Revised Manuscript with Track Changes: Lines 135-138, 469-473.)

In multiple univariate analysis, the Benjamini-Hochberg procedure was used to correct multiple comparisons. On the other hand, the data obtained from logistic regression analysis did not need to be modified because the logit model itself shows the corrected odds ratio.

(Revised Manuscript with Track Changes: Lines 229-231.)

However, repeating the tests with different logit models increases the likelihood of type I errors. Based on the reviewer’s comment, the result of the analysis with the forced entry model was deleted, so we thought that it is not necessary to revise the result of the multivariate analysis with the stepwise model again.

(Revised Manuscript with Track Changes: Lines 239-243, 347-348, 350-353, 401-408. Table 2 and 3.)

Reviewer #2:

Comment:

The topic is very interesting and could have a clinical impact.

The paper is specific, well-structured and precise in the technical description.

Response:

Thank you for your valuable feedback.

Comment:

The title is inherent in the purpose of the study, but too long and may not catch the reader's attention.

Response:

We have shortened the title and revised it to be more captivating. The previous title “Combining MMSE and brain MRI and SPECT indicators from the automated quantitative assessment applications VSRAD and eZIS improves accuracy of discrimination between mild cognitive impairment and early Alzheimer's disease” was changed to "The combination of MMSE with VSRAD and eZIS has greater accuracy for discriminating mild cognitive impairment from early Alzheimer’s disease than MMSE alone".

(Revised Manuscript with Track Changes: Lines 3-5, 7-9)

Comment:

The aim of the study is clearly exposed and well-argued.

The methods and the statistic evaluation are described in an accurate way.

The results are complete, presented in a logically corrected sequence and they are analyzed extensively in the discussion. Moreover, the authors underline the applicative value of the results in real-world.

Tables and graphics show adequate drafting modalities, sufficient length, layout and size.

Bibliographic references are appropriate and consistent.

Response:

Thank you for your encouraging remarks.

Comment:

The manuscript needs the following revisions:

• Title: it is preferable to review it, reducing its length and making it more captivating.

Response:

We have shortened the title and fixed it more captivating. The previous title “Combining MMSE and brain MRI and SPECT indicators from the automated quantitative assessment applications VSRAD and eZIS improves accuracy of discrimination between mild cognitive impairment and early Alzheimer's disease” was changed to "The combination of MMSE with VSRAD and eZIS has greater accuracy for discriminating mild cognitive impairment from early Alzheimer’s disease than MMSE alone".

(Revised Manuscript with Track Changes: Lines 3-5, 7-9.)

Comment:

• Results: (Patient characteristics) the lines 248-256 could be reduced to a single introductory sentence of Table 1, which is already explanatory and complete with all data.

Response:

We summarized the description of the results in Table 1 by removing unnecessary sentences.

(Revised Manuscript with Track Changes: Lines 282-289 and Table 1.)

Journal requirements:

Comment:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

Response:

We revised the manuscript following PLOS ONE’s style requirements, particularly the file name and template of the title page.

Comment:

2. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu) and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ

Response:

The ORCID id of the Corresponding Author (Dr. Norio Yasui-Furukori) has been registered in the Editorial Manager account.

3. Thank you for stating the following in the Competing Interests section:

"Norio Yasui-Furukori has been a speaker for Dainippon-Sumitomo Pharmaceutical, Mochida Pharmaceutical, and MSD. Kazutaka Shimoda has received research support from Meiji Seika Pharma Co., Pfizer Inc., Dainippon Sumitomo Pharma Co., Ltd., Daiichi Sankyo Co., Otsuka Pharmaceutical Co., Ltd., Astellas Pharma Inc., Novartis Pharma K.K., Eisai Co., Ltd., Takeda Pharmaceutical Co., Ltd. and honoraria from Mitsubishi Tanabe Pharma Corporation, Meiji Seika Pharma Co., Ltd., Dainippon Sumitomo Pharma Co., Ltd., Takeda Pharmaceutical Co., Shionogi & Co., Ltd., Daiichi Sankyo Co., Pfizer Inc. and Eisai Co., Ltd. The companies had no role in the study design, the data collection and analysis, the decision to publish, or the preparation of the manuscript. The remaining authors declare that they have no competing interests to report. ".

i) Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests). If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Response:

Our competing interests do not affect compliance with PLOS ONE's policies.

The following sentences have been added.

“This does not alter our adherence to PLOS ONE policies on sharing data and materials.”

(Revised Manuscript with Track Changes: Lines 522-523)

Comment:

ii) Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

Response:

The updated Competing Interests statement has been included in the cover letter.

We added the following sentence to the end of the competing interests.

“This does not alter our adherence to PLOS ONE policies on sharing data and materials.”

(Revised Manuscript with Track Changes: Lines 522-523.)

Comment:

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with or could reasonably be perceived as interfering with the full and objective presentation, peer review, editorial decision-making, or publication of research or nonresearch articles submitted to one of the journals. Competing interests can be financial or nonfinancial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

Response:

We fully understand the PLOS ONE policy for the declaration of competing interests among corresponding authors.

Comment:

4. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

Response:

The ethics committee of Towada City Central Hospital has set restrictions on data sharing.

Please contact the corresponding author for data requests. Upon request, the Ethics Commission will decide whether to share the data.

A contact information for our ethics committee: The institutional review board of the ethics committee of Towada City Hospital (Chairperson of the ethics committee: Dr. Masaru Kudo); Towanda City, Nishi 12-14-8, Aomori Prefecture, Japan, Postal Code 034-0093, Phone +81-716-23-5121, FAX +81-176-23-2999.

(Revised Manuscript with Track Changes: Lines 260-263, 503-510.)

Comment:

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a deidentified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

Response:

The ethics committee of Towada City Hospital has set restrictions on data sharing because the data contain potentially identifying or sensitive patient information. Please contact the corresponding author for data requests. Upon request, the ethics committee will decide whether to share the data.

A contact information for our ethics committee: The institutional review board of the ethics committee of Towada City Hospital (Chairperson of the ethics committee: Dr. Masaru Kudo); Towanda City, Nishi 12-14-8, Aomori Prefecture, Japan, Postal Code 034-0093, Phone +81-716-23-5121, FAX +81-176-23-2999.

(Revised Manuscript with Track Changes: Lines 260-263, 503-510.)

Comment:

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to deidentify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

Response:

The ethics committee of Towada City Hospital has set restrictions on data sharing because the data contain potentially identifying or sensitive patient information. Please contact the corresponding author for data requests. Upon request, the ethics committee will decide whether to share the data.

A contact information for our ethics committee: The institutional review board of the ethics committee of Towada City Hospital (Chairperson of the ethics committee: Dr. Masaru Kudo); Towanda City, Nishi 12-14-8, Aomori Prefecture, Japan, Postal Code 034-0093, Phone +81-716-23-5121, FAX +81-176-23-2999.

(Revised Manuscript with Track Changes: Lines 260-263, 503-510.)

Comment:

5. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please delete it from any other section.

Response:

We deleted ethical statements other than those listed in the Methods section from our manuscript.

(Revised Manuscript with Track Changes: Lines 488-493, 496-499.)

Decision Letter 1

Stephen D Ginsberg

8 Feb 2021

The combination of MMSE with VSRAD and eZIS has greater accuracy for discriminating mild cognitive impairment from early Alzheimer’s disease than MMSE alone

PONE-D-20-30261R1

Dear Dr. Yasui-Furukori,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Stephen D. Ginsberg, Ph.D.

Section Editor

PLOS ONE

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: All inquiries were successfully addressed. The authors have improved their statistical analysis and addressed the clinical and methodological questions.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Dr. Jaime Daniel Mondragon

Acceptance letter

Stephen D Ginsberg

11 Feb 2021

PONE-D-20-30261R1

The combination of MMSE with VSRAD and eZIS has greater accuracy for discriminating mild cognitive impairment from early Alzheimer’s disease than MMSE alone

Dear Dr. Yasui-Furukori:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Stephen D. Ginsberg

Section Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    The ethics committee of Towada City Hospital has set restrictions on data sharing because the data contain potentially identifying or sensitive patient information. Please contact the institutional review board of the ethics committee of Towada City Hospital for data requests. Upon request, the ethics committee will decide whether to share the data. Contact information for our ethics committee: The institutional review board of the ethics committee of Towada City Hospital (Chairperson of the ethics committee: Dr. Masaru Kudo); Towanda City, Nishi 12-14-8, Aomori Prefecture, Japan, Postal Code 034-450 0093, Phone +81-716-23-5121, FAX +81-176-23-2999.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES