Abstract
Background and Aim
Data showing the usefulness of MRI to improve the accuracy of the diagnostic process in cognitive disorders were derived from studies in tertiary referral centers. MRI is widely used as a diagnostic tool in everyday practice, but it is unknown what the actual added value of MRI is. We studied the usefulness of MRI in the diagnostic process by measuring the change of confidence of the physician.
Methods
Physicians indicated confidence in their diagnosis before and after presentation of MR images using a visual analogue scale from 0-100%.
Results
Use of MRI increased the level of confidence by 3% in experienced clinicians and by 9% in inexperienced physicians. In 2/125 cases, MRI showed an unexpected finding.
Conclusion
MRI is a useful diagnostic tool in everyday practice of diagnosing cognitive disorders.
Key Words: Diagnostic confidence, Cognitive disorder, Visual analogue scale, MRI
Introduction
In the international guidelines on the recommended diagnostic approach of patients presenting with cognitive disorders, neuroimaging is mentioned as a tool to exclude treatable causes of a dementia syndrome [1, 2, 3, 4, 5]. Neuroimaging is also a diagnostic method to increase the accuracy of diagnostic classification [6, 7]. The data to support this are mainly derived from studies in tertiary referral centers [8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21].
The availability of MRI and CT outside tertiary referral centers has led to the routine use of these tools in the diagnostic process of cognitive dysfunction. The most recent version of the Dutch outpatient memory clinics survey reported that more than 80% of patients undergo neuroimaging [22]. However, to our knowledge there are no data available on how physicians outside tertiary referral centers use MRI in the diagnostic process of cognitive dysfunction.
We studied the usefulness of MRI in a memory clinic diagnostic program in a community-based hospital by asking physicians to what extent neuroimaging supports their diagnostic confidence. We used a probabilistic method to mimic the clinical weighing of MR results in a diagnostic process.
Subjects and Methods
Patients
We included all consecutive patients seen between January 2012 and April 2013 at the Medical Center Alkmaar memory clinic after they gave written informed consent Exclusion reasons were refusal or inability to undergo MRI.
The diagnostic program comprised of taking a medical history, physical and neurological examination, a neuropsychological evaluation, clinical laboratory tests, ECG and MRI. The local ethics committee approved the study.
Neuropsychological Test Battery
The neuropsychological test battery included the Visual Association Test and the direct Word List Learning, delayed verbal recall and recognition, Trailmaking A and B, Stroop, Rey Complex Figure, CAMCOG gnosis, Clock Drawing Test, the Verhage Education Level, parts of the Groningen Intelligence Test to estimate premorbid IQ, parts of the Amsterdam Dementia Screenings Test being orientation, meander, fluency and copy drawing. The Cognitive Screenings Test was used to extrapolate the MMSE score. The Clinical Dementia Rating Scale, Geriatric Depression Scale, Neuropsychiatric Inventory-Questionnaire, Informant Questionnaire of Cognitive Decline (IQ-CODE) and the Lawton IADL and Katz ADL were also used in this test battery.
MRI
MR images were acquired on a 1.5-Tesla machine. The scanning protocol included (1) a 3D T1-weighted sequence: coronal orientation, whole brain coverage with 1.5 mm slice thickness, (2) a FLAIR sequence with a 5 mm slice thickness and slice gap of 0.5 mm, and (3) a transverse T2-weighted turbo spin echo sequence with 5 mm slice thickness and slice gap of 0.5 mm. All images were acquired with an in-plane resolution of 1 × 1 mm.
Images were scored using the assessment of the Global Cortical Atrophy (GCA) four-point rating scale developed by Pasquier et al. [23], assessment of the Medial Temporal Atrophy (MTA) five-point visual rating scale described by Scheltens et al. [18], estimation of white matter hyperintensities (WMH) by using the Fazekas score [12] and number and localization of lacunar infarcts. GCA and WMH were assessed on a FLAIR image. The MTA score was assessed in the coronal reconstructions of the T1-weighted MPRAGE perpendicular to the hippocampus axis. Lacunas were defined as hypointense lesions on FLAIR and hyperintense lesions on T2 images with a minimum diameter of 3 mm and were distinguished from Virchow-Robin spaces based on their location and the presence of a hyperintensive rim on the axial 2D FLAIR image.
Diagnostic Classification
Patients were diagnosed with probable or possible Alzheimer's disease (AD) if they fulfilled NINCDS-ADRDA criteria [4], frontotemporal lobe dementia using the criteria of Neary et al. [24], vascular dementia (VaD) by the NINCDS-AIREN criteria [25], dementia with Lewy bodies using the criteria of McKeith et al. [26], Parkinson's disease dementia complex, and dementia without a distinctive etiology. Non-demented patients either were categorized as healthy or having subjective cognitive complaints, symptoms of a cognitive disorder probably caused by a developmental psychological disorder, a psychiatric or neurological disorder or patients were diagnosed with mild cognitive impairment (MCI) according to the Petersen and the revised Petersen criteria [27, 28].
Measuring Confidence
All available diagnostic information was discussed in a standard order by a multidisciplinary team of geriatricians, geriatric medicine trainees, a neurologist, an old age psychiatrist, a neuropsychologist and a specialized nurse. Before this meeting, the physician was unaware of the results of MRI and the test battery. After presentation of the basic clinical information, the physician indicated on a visual analogue scale (VAS) a level of confidence about the clinical diagnosis, ranging from 0–100%.
The VAS is a frequently used method to indicate pain [29, 30, 31, 32, 33], experienced physical health [34] or indicate mood [35]. It has also been used to measure the confidence of clinicians in the diagnostic process of ankle [36] or carotid pathology [37].
After indication of a first measure of confidence, MR images were always presented by the same physician (first author, L.B.). All available MRI sequences were presented in the same way using the various described scales and in the same order. The physicians then gave a second estimation of the extent of their confidence. Afterwards, the neuropsychologist presented the results of the test battery and following this, when available, additional biomarker results were discussed. Finally, the physicians were asked to indicate which of the MRI, the test battery or additional biomarker results predominantly influenced their confidence in the diagnosis.
The left end of a 10-cm-long VAS signifies no confidence at all in the clinical diagnosis, the right side represents complete confidence in the diagnosis. The VAS scores were used as percentage scores of diagnostic certainty.
The level of certainty may increase, decrease or remain unchanged after the assessment of MR images. If the number of increased and decreased changes and their extent would be balanced, this could result in a mean change of 0%, thereby obscuring possible clinically relevant effects of MRI on level of confidence. We therefore also computed absolute differences where increased and decreased levels of confidence were added up and negative results were multiplied by −1, giving a measure of change of confidence.
We also studied the usefulness of MRI by counting the number of diagnoses that changed due to assessment of MRI. The measure of change of confidence might be small butin this case it would nonetheless be clinically relevant when a number of diagnoses were changed after assessment of MRI.
In the analysis of the measures of confidence, we distinguished a group of experienced and a group of inexperienced physicians, as we expected that experience would influence the measure and the change of diagnostic certainty by using MRI. Physicians were considered experienced when they had been a consultant for more than 5 years. We checked for an effect of experience in a post hoc analysis.
Prior to the start of the study, the experienced raters were asked to give a measure of change in their certainty using MR results that would be clinically relevant to them. They all indicated independently that 20% was a clinically relevant change in certainty. This percentage, an alpha of 0.05 and a power of 0.80 were used to make a power calculation. The number needed to analyze was 50. To compare change of certainty in the two groups of physicians, we aimed at an inclusion of 100 patients.
A possible problem of a VAS is that the position of the first indication of the confidence level on the VAS might influence the positioning of the second indication, resulting in a smaller change in confidence level. To control for this possibility, we performed a vignette study where we presented four experienced geriatricians 50 vignette patients unknown to them. They were asked to write down a diagnosis after reading the vignettes and indicate a level of confidence. This procedure was repeated after 12 months to make sure they had no recollection of their former assessment. In the second round, they were given the same vignettes and indicated a level of confidence after they read the vignettes and were shown the MR images. They were also asked to give an indication of confidence level after providing them with the test results so to be able to quantify the clinical importance of these results in comparison to the results of MRI.
Statistical Analysis
We used the SPSS version 20 (for Windows) for statistical analysis. Results are expressed as n (%) or means in SD unless indicated otherwise. Frequency distributions for categorical variables were compared with the Fisher exact test To compare means, either the dependent or independent t test statistic was used and when a small number of cases was studied, the non-parametric Kruskal-Wallis statistic was applied. ANOVA was used to compare age and MMSE between groups.
The main study outcome was the proportion of change in the level of confidence in the clinical diagnosis before and after assessment of the MR images.
Results
MRI data were available for 125 consecutively referred patients. Reasons for exclusion were a pacemaker (n = 5) and refusal (n = 4). Another 6 had recently undergone CT imaging. In these 6 patients, CT imaging was performed to check the location of a deep brain stimulus device (n = 1), to rule out a cerebrovascular event (n = 1), to check for cerebral metastases in a patient suffering of lung cancer (n = 1), and to minimize scan time because of frailty due to progressive chronic obstructive pulmonary disease, panic disorder and behavioral aggressive disorder, respectively. Demographic characteristics of the sample are presented in table 1.
Table 1.
Demographics, MMSE and diagnosis before and after discussion of MR results in the two physician groups
Experienced (n = 3) | Inexperienced (n = 3) | |
---|---|---|
Patients, n | 66 | 59 |
Mean age ± SD, years | 73±8.1 | 72±8,7 |
Female sex | 32 (48) | 22 (37) |
Mean MMSE ± SD | 25±4.1 | 25±4.5 |
Pre-MRI diagnosis | ||
Subjective symptoms | 6 (9) | 8 (14) |
MCI | 38 (58)a | 22 (37) |
AD | 10 (15)b | 10 (17) |
VaD | 0 | 6 (10) |
Other dementias | 5 (8)c | 5 (8) |
Other neurology | 1 (2) | 3 (5) |
Psychiatry | 5 (8) | 2 (3) |
Other diagnosis | 1 (2) | 3 (5) |
Post-MRI diagnosis | ||
Subjective symptoms | 9 (14) | 7 (12) |
MCI | 38 (58) | 23 (39) |
AD | 10 (15) | 10 (17) |
VaD | 0 | 2 (3) |
Other dementias | 5 (8) | 5 (8) |
Other neurology | 0 | 5 (8) |
Psychiatry | 3 (5) | 3 (5) |
Other diagnosis | 1 (2) | 4 (7) |
Values are shown as n (%), unless otherwise indicated.
MCI = MCI-a + MCI-md + vascular cognitive impairment.
AD = AD + mixed AD.
Other dementias = dementia with Lewy bodies + frontotemporal lobe dementia + Parkinson's disease dementia complex.
We compared diagnoses across the groups of experienced and inexperienced clinicians. As the number of patients in some diagnostic groups was low, comparisons were made for four groups: subjective symptoms, MCI, AD and other dementias. Diagnoses made by the two groups of physicians did not differ significantly for the pre-MRI diagnosis groups (ϧ2 = 2.71, p > 0.05) or for the post-MRI diagnoses (χ2 = 1.27, p > 0.05). Results of the indications of diagnostic certainty before and after presentation of MR images are presented in table 2. In 2 patients, no post-MRI indications of diagnostic certainty were available which allowed us to study the results of 123 patients.
Table 2.
Physician confidence in pre- and post-MRI diagnosis in mean percentages and SD, t test statistic and significance level
n | Mean % (SD) | t test | p | |
---|---|---|---|---|
All physicians | ||||
Pre-MRI | 123 | – | –4.789 | <0.001 |
Post-MRI | 123 | 75 (14.7) | ||
Experienced physicians | ||||
Pre-MRI | 66 | 69 (13.9) | –1.827 | 0.072 |
Post-MRI | 66 | 72 (15) | ||
Non-experienced physicians | ||||
Pre-MRI | 57 | 70 (12.1) | –5.038 | <0.001 |
Post-MRI | 57 | 79 (13.4) | ||
Absolute differences pre- and post-MRI | ||||
All physicians | 123 | 11 (9.6) | ||
Experienced physicians | 66 | 9 (8.1) | 1.767 | 0.08 |
Non-experienced physicians | 57 | 12 (10.9) |
The physicians indicated a mean 5% increase in their diagnostic certainty (independent-samples t test, t = −4.789, p < 0.001). There was an effect of level of experience. The mean increase of confidence in the experienced group was 3% (dependent-samples t test, t = −1.827, p = 0.072) and in the inexperienced group it was 9% (dependent-samples t test, t = −5.038, p < 0.001). In absolute differences, the change of diagnostic certainty was 9% in the experienced group and 12% in the inexperienced group (independent-samples t test, t = 1.767, p = 0.08). Combined for both groups, this difference was 11%.
In 18% of cases, the diagnosis was changed due to assessment of MR images. For the diagnosis groups mentioned in table 1, the number of cases with a new diagnosis after MRI out of the total number of cases in this diagnosis group before MRI were, respectively, subjective symptoms 2/14, MCI 9/60, AD 4/17, VaD 3/5, other dementias 0/10, other neurology 1/3, psychiatry 2/7.
Pre- and post-MRI certainty did not differ for different age groups. All mean absolute differences varied around 11%. On visual inspection of the number of increased, decreased and unchanged levels of confidence and the corresponding boxplot, there seemed to be an effect of age in the number of assessments with an increased confidence level. This was highest in the youngest age group (65%), a figure that varied around 50 % in the older age groups. The number of decreased levels in the youngest age group [11%) doubled in the oldest age group (table 3). This trend is illustrated in the boxplot where the number of absolute differences above the median of 10% in the youngest age group is greater than in the oldest age group (fig. 1). This effect, however, was not statistically significant.
Table 3.
Mean absolute differences in confidence levels before and after MRI, and number of assessments with an increased, decreased or equal confidence level before and after MRI in different age groups
Mean absolute difference in CL, % (SD) | IL, n | DL, n | NL, n | |
---|---|---|---|---|
All patients | 11 (9.6) | 55 | 16 | 29 |
Age group | ||||
<70 years (n = 43) | 12 (8.6) | 65 | 11 | 24 |
70–79 years (n = 45) | 11 (10.6) | 49 | 16 | 35 |
≥80 years (n = 35) | 10 (9.4) | 51 | 23 | 26 |
CL = Confidence level; IL = increased confidence level; DL = decreased confidence level; NL = equal confidence level.
Fig. 1.
Boxplot of mean absolute differences in confidence levels before and after MRI for three age groups.
Experienced physicians indicated in 51 (80%) cases the test battery as most helpful in increasing their confidence level. Inexperienced physicians indicated in 38 (66%) cases the test battery as most helpful (χ2 = 3.096, p = 0.078).
Results of the Vignette Study
Table 4 shows the results of the case vignette study. The case vignette study showed a mean increase in confidence before and after MRI of 7% (paired-samples t test, t = −5.046, p = 0.000). In an absolute figure, this amounted to 11%. The level of confidence increased from 69% after MRI to 82% after additional presentation of test results, which represented a significant difference in a paired-samples t test (t = −5.998, p = 0.000). In an absolute figure, this difference was 16%.
Table 4.
Vignette substudy, levels of confidence in percentages and SD for mean increase and mean absolute change, t statistic and level of significance
n | Mean (SD) | t test | p | |
---|---|---|---|---|
Pre-MRI | 50 | 62 (9.9) | –5.046 | 0.000 |
Post-MRI | 50 | 69 (11.2) | –5.998 | 0.000 |
Post-MRI test results | 50 | 82 (11.7) | ||
Absolute change pre- and post MRI | 50 | 11 (7.1) | ||
Absolute change pre- and post-MRI test results | 50 | 16 (11.4) |
In 2/125 cases, MRI showed an unexpected finding. In 1 patient, a glioblastoma multiforme was diagnosed on MRI as a cause of a rapidly progressive cognitive disorder. Another MRI suggested cerebral toxoplasmosis in a patient that received a kidney transplantation in 2003 and since then used medication that impaired the immune system. Four patients were diagnosed with VaD. In 6 patients who underwent CT imaging, no treatable causes of cognitive symptoms were found.
Discussion
In this study, we evaluated how MRI findings influence the clinical diagnostic certainty. Physicians indicated a statistically significant mean increase of 5% in their level of confidence, this was an 11% absolute difference.
The effect of using MRI was probably larger due to two factors. In the main study, the pre- and post-MRI indications of confidence were given on the same form. The position of the first indication could have influenced the positioning of the second indication resulting in a smaller change of confidence. The vignette study was performed to check for this psychological mechanism. The results of the vignette study suggest that the position of the first indication indeed influenced the positioning of the second indication. The percentages’ mean increase and absolute difference were larger in the vignette study in comparison to findings in the experienced group in the main study. Also, given our finding that inexperienced physicians indicated even higher percentages, the mean increase of 7% and the 11% absolute difference of the vignette study are therefore probably reliable indications of the effect of using MRI assessment on the experienced level of confidence. The second factor is the skewedness of the distributions of confidence. This compresses the distances between the indicated confidence levels. When these differences would be projected on a line with normal distribution, the differences pre- and post-MRI would probably be greater.
In the literature, we found one report in which the minimum clinically significant difference in VAS pain scores for acute pain were studied [32]. These authors suggest that 9 mm, in our study 9%, is the minimum change to be regarded as being clinically relevant. A VAS has not been used before in the way we did and we therefore cannot make any comparisons. We consequently feel, given that the percentages we found are in the range of 9%, that our results are clinically relevant and indicate that MRI is a useful diagnostic tool in the setting of our practice.
As far as we know, this is the first study that tried to quantify the subjectively experienced clinical usefulness of MRI in everyday practice of diagnosing cognitive syndromes in an outpatient memory clinic outside a tertiary referral center. We hypothesized that the level of diagnostic confidence would differ between experienced and inexperienced physicians. This proved to be the case, although in absolute figures the difference was not significant. We furthermore studied the reliability of our method by performing a vignette study. Another strength of this study was the inclusion of all consecutively referred patients to the memory clinic. No patients refused to sign an informed consent form and all but 6 patients underwent MRI. We therefore do not expect an important selection bias in our results.
We did not study the effect of patients’ age on the change of the feeling of confidence in the diagnosis by using MRI. In retrospect, we feel this is a weakness of the study as it is well known that with increasing age there is an increasing overlap between anatomical changes due to age and due to the presence of a neurodegenerative disease. Age could therefore influence the way physicians use MRI in diagnosing disease. It would be valuable to know the effect of age on the way MRI is used and consequently have an indication how to use MRI in younger and older patients.
Although on inspection of table 3 and figure 1 there seemed to be an age effect on change of the confidence level, this was not a statistically significant effect. This might be due to the small number of cases per age group available in this analysis.
As a side result, we confirmed earlier studies that reported on the number of treatable causes of a cognitive syndrome diagnosed by imaging the brain [38, 39, 40]. In our study, we found unexpected findings in only 2 of 125 MRI cases. The glioblastoma was deemed untreatable at the moment of discovery in the 86-year-old patient The immune-compromised patient thought to have a cerebral toxoplasmosis was eventually diagnosed suffering from a cerebral B-cell lymphoma and died shortly afterwards. In the 6 patients that underwent a CT of the brain previously to this study, no treatable causes of dementia were found. Also, in patients showing cerebral lacunar infarcts secondary preventive treatment for cerebrovascular disease was started in an earlier phase. No large cerebral infarcts were found.
We conclude that in a community-based memory clinic, MRI increases the level of certainty of physicians about their diagnosis. The results suggest that inexperienced clinicians gain more confidence than experienced colleagues using this diagnostic tool. It would be worthwhile to study the effect of age of the patients on the change of confidence using MRI. In addition, we confirmed earlier studies reporting the low yield of finding treatable causes using neuroimaging.
Disclosure Statement
The authors declare no conflicts of interest for this article.
Acknowledgments
The authors would like to thank the colleagues of the Department of Geriatric Medicine, the doctors M. Popescu, J. Peetoom, J. Wold and R. Jansen for their willingness to be a subject in the vignette study.
References
- 1.Dubois B, Feldman HH, Jacova C, DeKosky ST, Barberger-Gateau P, Cummings J, et al. Research criteria for the diagnosis of Alzheimer's disease: revising the NINCDS-ADRDA criteria. Lancet Neurol. 2007;6:734–746. doi: 10.1016/S1474-4422(07)70178-3. [DOI] [PubMed] [Google Scholar]
- 2.Hort J, O'Brien JT, Gainotti G, et al. EFNS guidelines for the diagnosis and management of Alzheimer's disease. Eu J Neurol. 2010;17:1236–1248. doi: 10.1111/j.1468-1331.2010.03040.x. [DOI] [PubMed] [Google Scholar]
- 3.Knopman DS, DeKosky ST, Cummings JL, Chui H, Corey-Bloom J, Relkin N, et al. Practice parameter: diagnosis of dementia (an evidence-based review). Report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology. 2001;56:1143–1153. doi: 10.1212/wnl.56.9.1143. [DOI] [PubMed] [Google Scholar]
- 4.McKhann GM, Knopman DS, et al. The diagnosis of dementia due to Alzheimer's disease: recommendations from the National Institute of Aging-Alzheimer's Association workgroup on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement. 2011;7:263–269. doi: 10.1016/j.jalz.2011.03.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Sorbi S, Hort J, Erkinjuntti T, Fladby T, Gainotti G, Gurvit H, et al. EFNS-ENS Guidelines on the diagnosis and management of disorders associated with dementia. Eur J Neurol. 2012;19:1159–1179. doi: 10.1111/j.1468-1331.2012.03784.x. [DOI] [PubMed] [Google Scholar]
- 6.Barkhof F, Fox NC, Bastos-Leite AJ, Scheltens P. Neuroimaging in Dementia. Berlin: Springer; 2011. [Google Scholar]
- 7.Scheltens P, Fox N, Barkhof F, De Carli C. Structural magnetic resonance imaging in the practical assessment of dementia: beyond exclusion. Lancet Neurol. 2002;1:13–21. doi: 10.1016/s1474-4422(02)00002-9. [DOI] [PubMed] [Google Scholar]
- 8.Barber R, Gholkar A, Scheltens P, Ballard C, McKeith IG, O'Brien JT. Medial temporal lobe atrophy on MRI in dementia with Lewy bodies. Neurology. 1999;52:1153–1158. doi: 10.1212/wnl.52.6.1153. [DOI] [PubMed] [Google Scholar]
- 9.Bosscher L, Scheltens P. MRI of the medial temporal lobe for the diagnosis of Alzheimer's disease. In: Qizilbash N, Schneider LS, Chui H, et al., editors. Evidence-Based Dementia Practice. Oxford: Blackwell Publishing; 2002. pp. 154–162. [Google Scholar]
- 10.Boutet C, Chupin M, Colliot O, Sarazin M, Mutlu G, Drier A, et al. Is radiological evaluation as good as computer-based volumetry to assess hippocampal atrophy in Alzheimer's disease? Neuroradiology. 2012;54:1321–1330. doi: 10.1007/s00234-012-1058-0. [DOI] [PubMed] [Google Scholar]
- 11.DeCarli C, Frisoni GB, Clark CM, Harvey D, Grundman M, Petersen RC, et al. Qualitative estimates of medial temporal atrophy as a predictor of progression from mild cognitive impairment to dementia. Arch Neurol. 2007;64:108–115. doi: 10.1001/archneur.64.1.108. [DOI] [PubMed] [Google Scholar]
- 12.Fazekas F, Chawluk JB, Alavi A, et al. MR signal abnormalities at 1.5 T in Alzheimer's dementia and normal aging. AJR Am J Roentgenol. 1987;149:351–356. doi: 10.2214/ajr.149.2.351. [DOI] [PubMed] [Google Scholar]
- 13.Geroldi C, Rossi R, Calvagna C, et al. Medial temporal atrophy but not memory deficit predicts progression to dementia in patients with mild cognitive impairment. J Neurol Neurosurg Psychiatry. 2006;77:1219–1222. doi: 10.1136/jnnp.2005.082651. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Koedam LG, Lehmann M, van der Flier WM, et al. Visual assessment of posterior atrophy development of a MRI rating scale. Eur Radiol. 2011;21:2618–2625. doi: 10.1007/s00330-011-2205-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Korf ES, Wahlund LO, Visser PJ, Scheltens P. Medial temporal lobe atrophy on MRI predicts dementia in patients with mild cognitive impairment. Neurology. 2004;63:94–100. doi: 10.1212/01.wnl.0000133114.92694.93. [DOI] [PubMed] [Google Scholar]
- 16.Launer LJ, Scheltens P, Lindeboom J, Barkhof F, Weinstein HC, Jonker C. Medial temporal lobe atrophy in an open population of very old persons: cognitive, brain atrophy, and sociomedical correlates. Neurology. 1995;45:747–752. doi: 10.1212/wnl.45.4.747. [DOI] [PubMed] [Google Scholar]
- 17.Petersen RC, Jack CR, Jr, Xu YC, Waring SC, O'Brien PC, Smith GE, et al. Memory and MRI-based hippocampal volumes in aging and AD. Neurology. 2000;54:581–587. doi: 10.1212/wnl.54.3.581. [DOI] [PubMed] [Google Scholar]
- 18.Scheltens P, Leys D, Barkhof F, et al. Atrophy of medial temporal lobes MRI in Alzheimer's disease and normal aging: diagnostic value and neuropsychological correlates. J Neurol Neuropsychol Psychiatry. 1992;55:967–972. doi: 10.1136/jnnp.55.10.967. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Scheltens P, Pasquier F, Weerts JG, Barkhof F, Leys D. Qualitative assessment of cerebral atrophy on MRI: inter- and intra-observer reproducibility in dementia and normal aging. Eur Neurol. 1997;37:95–99. doi: 10.1159/000117417. [DOI] [PubMed] [Google Scholar]
- 20.Visser PJ, Scheltens P, Verhey FR, Schmand B, Launer LJ, Jolles J, et al. Medial temporal lobe atrophy and memory dysfunction as predictors for dementia in subjects with mild cognitive impairment. J Neurol. 1999;246:477–485. doi: 10.1007/s004150050387. [DOI] [PubMed] [Google Scholar]
- 21.Wahlund LO, Julin P, Johansson SE, et al. Visual rating and volumetry of the medial temporal lobe on magnetic resonance imaging in dementia: a comparative study. J Neurol Neurosurg Psychiatry. 2000;69:630. doi: 10.1136/jnnp.69.5.630. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Ramakers IHGB, Verhey FRJ. Development of memory clinics in the Netherlands: 1998 to 2009. Aging Ment Health. 2011;15:34–39. doi: 10.1080/13607863.2010.519321. [DOI] [PubMed] [Google Scholar]
- 23.Pasquier F, Leys D, Weerts JG, Mounier-Vehier F, Barkhof F, Scheltens P. Inter- and intraobserver reproducibility of cerebral atrophy assessment on MRI scans with hemispheric infarcts. Eur Neurol. 1996;36:268–272. doi: 10.1159/000117270. [DOI] [PubMed] [Google Scholar]
- 24.Neary D, Snowden JS, Gustafson L, Passant U, Stuss D, Black S, et al. Frontotemporal lobar degeneration: a consensus on clinical diagnostic criteria. Neurology. 1998;51:1546–1554. doi: 10.1212/wnl.51.6.1546. [DOI] [PubMed] [Google Scholar]
- 25.Roman GC, Tatemichi TK, Erkinjuntti T, Cummings JL, Masdeu JC, Garcia JH, et al. Vascular dementia: diagnostic criteria for research studies. Report of the NINDS-AIREN International Workshop. Neurology. 1993;43:250–260. doi: 10.1212/wnl.43.2.250. [DOI] [PubMed] [Google Scholar]
- 26.McKeith IG, Dickson DW, Lowe J, Emre M, O'Brien JT, Feldman H, et al. Diagnosis and management of dementia with Lewy bodies: third report of the DLB Consortium. Neurology. 2005;65:1863–1872. doi: 10.1212/01.wnl.0000187889.17253.b1. [DOI] [PubMed] [Google Scholar]
- 27.Petersen RC, Smith GE, Waring SC, Ivnik RJ, Tangalos EG, Kokmen E. Mild cognitive impairment: clinical characterization and outcome. Arch Neurol. 1999;56:303–308. doi: 10.1001/archneur.56.3.303. [DOI] [PubMed] [Google Scholar]
- 28.Petersen RC, Stevens JC, Ganguli M, Tangalos EG, Cummings JL, DeKosky ST. Practice parameter: early detection of dementia: mild cognitive impairment (an evidence-based review). Report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology. 2001;56:1133–1142. doi: 10.1212/wnl.56.9.1133. [DOI] [PubMed] [Google Scholar]
- 29.Bodian CA, Freedman G, Hossain S, Eisenkraft JB, Beilin Y. The visual analog scale for pain: clinical significance in postoperative patients. Anesthesiology. 2001;95:1356–1361. doi: 10.1097/00000542-200112000-00013. [DOI] [PubMed] [Google Scholar]
- 30.Carlsson AM. Assessment of chronic pain. I. Aspects of the reliability and validity of the visual analogue scale. Pain. 1983;16:87–101. doi: 10.1016/0304-3959(83)90088-X. [DOI] [PubMed] [Google Scholar]
- 31.Gallagher EJ, Bijur PE, Latimer C, Silver W. Reliability and validity of a visual analog scale for acute abdominal pain in the ED. Am J Emerg Med. 2002;20:287–290. doi: 10.1053/ajem.2002.33778. [DOI] [PubMed] [Google Scholar]
- 32.Kelly AM. Does the clinically significant difference in visual analog scale pain scores vary with gender, age, or cause of pain? Acad Emerg Med. 1998;5:1086–1090. doi: 10.1111/j.1553-2712.1998.tb02667.x. [DOI] [PubMed] [Google Scholar]
- 33.Todd KH, Funk KG, Funk JP, Bonacci R. Clinical significance of reported changes in pain severity. Ann Emerg Med. 1996;27:485–489. doi: 10.1016/s0196-0644(96)70238-x. [DOI] [PubMed] [Google Scholar]
- 34.Boonstra AM, Schiphorst Preuper HR, Reneman MF, Posthumus JB, Stewart RE. Reliability and validity of the visual analogue scale for disability in patients with chronic musculoskeletal pain. Int J Rehabil Res. 2008;31:165–169. doi: 10.1097/MRR.0b013e3282fc0f93. [DOI] [PubMed] [Google Scholar]
- 35.Faehndrich E, Linden M. Reliability and validity of the Visual Analogue Scale (VAS) (in German) Pharmacopsychiatria. 1982;15:90–94. doi: 10.1055/s-2007-1019515. [DOI] [PubMed] [Google Scholar]
- 36.Bearcroft PWP, Guy S, Bradley M, Robinson F. MRI of the ankle: effect on diagnostic confidence and patient management. AJR Am J Roentgenol. 2006;187:1327–1331. doi: 10.2214/AJR.05.1071. [DOI] [PubMed] [Google Scholar]
- 37.Mitra D, Connolly D, Jenkins S, English P, Birchall D, Mandel C, et al. Comparison of image quality, diagnostic confidence and interobserver variability in contrast enhanced MR angiography and 2D time of flight angiography in evaluation of carotid stenosis. Br J Radiol. 2006;79:201–207. doi: 10.1259/bjr/72842752. [DOI] [PubMed] [Google Scholar]
- 38.Clarfield AM. The decreasing prevalence of reversible dementias: an updated meta-analysis. Arch Intern Med. 2003;163:2219–2229. doi: 10.1001/archinte.163.18.2219. [DOI] [PubMed] [Google Scholar]
- 39.van Crevel H, Van Gool WA, Walstra GJ. Early diagnosis of dementia: which tests are indicated? What are their costs? J Neurol. 1999;246:73–78. doi: 10.1007/s004150050311. [DOI] [PubMed] [Google Scholar]
- 40.Walstra GJ, Teunisse S, Van Gool WA, van Crevel H. Reversible dementia in elderly patients referred to a memory clinic. J Neurol. 1997;244:17–22. doi: 10.1007/pl00007724. [DOI] [PubMed] [Google Scholar]