Skip to main content
Frontiers in Aging Neuroscience logoLink to Frontiers in Aging Neuroscience
. 2014 Dec 1;6:300. doi: 10.3389/fnagi.2014.00300

Framingham Coronary Heart Disease Risk Score Can be Predicted from Structural Brain Images in Elderly Subjects

Jane Maryam Rondina 1,2,*, Paula Squarzoni 1,3, Fabio Luis Souza-Duran 1,3, Jaqueline Hatsuko Tamashiro-Duran 1,3, Marcia Scazufca 4, Paulo Rossi Menezes 5, Homero Vallada 3,4, Paulo A Lotufo 6, Tania Correa de Toledo Ferraz Alves 1,3,4, Geraldo Busatto Filho 1,3,4
PMCID: PMC4249461  PMID: 25520654

Abstract

Recent literature has presented evidence that cardiovascular risk factors (CVRF) play an important role on cognitive performance in elderly individuals, both those who are asymptomatic and those who suffer from symptoms of neurodegenerative disorders. Findings from studies applying neuroimaging methods have increasingly reinforced such notion. Studies addressing the impact of CVRF on brain anatomy changes have gained increasing importance, as recent papers have reported gray matter loss predominantly in regions traditionally affected in Alzheimer’s disease (AD) and vascular dementia in the presence of a high degree of cardiovascular risk. In the present paper, we explore the association between CVRF and brain changes using pattern recognition techniques applied to structural MRI and the Framingham score (a composite measure of cardiovascular risk largely used in epidemiological studies) in a sample of healthy elderly individuals. We aim to answer the following questions: is it possible to decode (i.e., to learn information regarding cardiovascular risk from structural brain images) enabling individual predictions? Among clinical measures comprising the Framingham score, are there particular risk factors that stand as more predictable from patterns of brain changes? Our main findings are threefold: (i) we verified that structural changes in spatially distributed patterns in the brain enable statistically significant prediction of Framingham scores. This result is still significant when controlling for the presence of the APOE 4 allele (an important genetic risk factor for both AD and cardiovascular disease). (ii) When considering each risk factor singly, we found different levels of correlation between real and predicted factors; however, single factors were not significantly predictable from brain images when considering APOE4 allele presence as covariate. (iii) We found important gender differences, and the possible causes of that finding are discussed.

Keywords: Framingham score, cardiovascular risk factors, magnetic resonance imaging, pattern recognition, multivariate analysis

Introduction

Cardiovascular risk factors (CVRF) such as hypertension, diabetes, dyslipidemia, and smoking, are highly prevalent in the elderly population and have significant impact on cognitive performance. In the last years, effects of CVRF on brain morphology have been widely investigated using neuroimaging resources. A number of morphometric studies using magnetic resonance imaging (MRI) (Korf et al., 2007; Almeida et al., 2008; Chen et al., 2012; Beauchet et al., 2013) have found decreased gray matter (GM) volumes in direct proportion to the degree of cardiovascular risk in otherwise healthy elderly individuals. In addition, studies using functional imaging methods such as positron emission tomography (PET) or functional MRI (fMRI) (Minoshima et al., 1997; Chetelat et al., 2003; Jagust, 2006; Kawachi et al., 2006; Mosconi et al., 2007; Marchand et al., 2011) have reported brain activity deficits also correlated with cardiovascular risk. These neuroimaging alterations often involve brain regions known to be implicated in the pathophysiology of Alzheimer’s disease (AD), such as the hippocampal region, posterior cingulate gyrus, temporal, and parietal cortices (Korf et al., 2004; Seshadri et al., 2004; Riello et al., 2005; Chen et al., 2006; Viswanathan et al., 2009; Neufang et al., 2011, 2013; Rasgon et al., 2011). Thus, such findings have provided critical support to the notion that the degree of cardiovascular risk may be a key influence in the development and course of AD.

Several studies applying neuroimaging to investigate the impact of cardiovascular risk on the brain have one important limitation, namely to consider each factor singly. As CVRF are widely known to seldom appear in isolation (Wilson et al., 1998; Jeerakathil et al., 2004; Seshadri, 2006; Razay et al., 2007), the influence of combined CVRF in imaging studies is likely to improve sensitivity to such investigations. Recently, our group examined GM changes in structural MRI data from elderly subjects with different degrees of cardiovascular risk (de Toledo Ferraz Alves et al., 2011) using the Framingham Coronary Heart Disease Risk [FCHDR (Grundy et al., 1998; Wilson et al., 1998)] score, a composite index comprising five clinical factors (age, blood pressure, diabetes mellitus, smoking status, and cholesterol levels). Given recent findings regarding cardiovascular risk effects on cognitive performance (Mosconi, 2005; Obisesan et al., 2008; Fitzpatrick et al., 2009; Purandare, 2009; Scarmeas et al., 2009; Buchman et al., 2012), the FCHDR score has presented excellent potential for investigations involving brain imaging (Elias et al., 2003; Jeerakathil et al., 2004; Massaro et al., 2004; Seshadri et al., 2004; DeCarli et al., 2005; Romero et al., 2009).

For the study by de Toledo Ferraz Alves et al. (2011), dementia-free individuals aged from 66 to 75 years were recruited from the database “São Paulo Aging and Health Study” (SPAH) (Scazufca and Seabra, 2008; Scazufca et al., 2008) and divided into three subgroups (high-risk, medium-risk, and low-risk) according to their FCHDR scores and gender (Table 1). Analyses of covariance were performed to investigate the presence of mean regional GM volume differences between the subgroups, followed by post hoc t-tests.

Table 1.

Division of subjects in risk groups according to FCHDR in males and females.

Group Male Female
Low risk Score ≤5 Score ≤9
Medium risk 5 < Score ≤8 9 < Score ≤14
High risk Score >8 Score >14

Using voxel-based morphometry (VBM) (Ashburner and Friston, 2000), the authors showed that the presence of CVRF was associated with mean regional GM loss involving the lateral temporal cortices bilaterally. They also observed a negative correlation between FCHDR scores and regional GM distribution in the lateral parietal cortex. Both areas are considered critical to pathophysiology of AD (Garrido et al., 2002; Mosconi et al., 2007; Yakushev et al., 2009; Ystad et al., 2009).

Several studies in this area do not take into account information regarding the major genetic risk factor for AD – the epsilon 4 (ε4) variant of the gene encoding the apolipoprotein E (APOE allele 4, APOE *4, or APOE 4) (Reiman, 2007; Cherbuin et al., 2008). This is a limitation since the presence of the APOE-4 allele carrier is also a risk factor for cardiovascular diseases and may be associated with variations in brain structure and functioning, even in non-elderly adults (Kivipelto et al., 2008). In our previous VBM investigation (de Toledo Ferraz Alves et al., 2011), regional GM differences across groups retained significance when considering the APOE 4 allele as a covariate of interest. This finding brought additional support to the hypothesis of a direct effect of CVRF on the brain, and consequently, a possible non-genetically determined influence on the development of AD-like brain abnormalities caused by microvascular-related changes in the general population.

The results of our previous investigation are, however, likely to have been influenced by common limitations in brain imaging studies. These include the increased chance of type I errors due to the large number of statistical comparisons across the entire brain, as well as the univariate, voxel-by-voxel nature of conventional VBM approaches that force investigators to address brain abnormalities pertaining to each brain compartment (GM, white matter, and cerebrospinal fluid space) separately. In the present study, we aimed to address these limitations using multivariate analysis. This approach takes into account covariance relations across brain regions/voxels, rather than a voxel-by-voxel comparison. The covariance approach can present greater statistical power in comparison with univariate techniques, as corrections for voxel-wise multiple comparisons are not necessary. Additionally, as voxels from the whole brain are modeled together, their results can be interpreted as a signature of neural networks.

Another critical limitation of conventional VBM studies is related to their restriction to mean group comparisons, with no information affordable for individual subjects. Analyses of individual subjects are feasible using contemporary pattern recognition (PR) methods. These methods are relevant as they provide indices of diagnostic accuracy, and these can be potentially useful to measure individual risks of favorable outcomes. PR methods for classification have been increasingly applied in the field of neurodegenerative dementias. Classifiers using morphometric MRI data have presented high indices of diagnostic accuracy that reinforce the diagnosis of AD, the commonest form of dementia (Vemuri et al., 2008; Magnin et al., 2009; Plant et al., 2010; Dai et al., 2012; Liu et al., 2012). These techniques have also afforded promising results in studies related to MCI – cognitive decline not severe enough to fulfill the criteria for established dementia (Misra et al., 2009; Aksu et al., 2011; Chincarini et al., 2011; Cui et al., 2011; Davatzikos et al., 2011; Zhang and Shen, 2012). However, the latter is still an open area with intense investigations, as predicting whether individuals who are at increased risk convert to AD is more challenging than classifying AD versus control individuals.

Given that CVRF are nowadays recognized as important risk factors for AD, it is relevant to investigate whether PR techniques are capable of discriminating individuals with variable degrees of cardiovascular risk based on MRI data. Another important approach in the present work is to apply a multivariate regression method in order to evaluate whether it is possible to predict the FCHDR score individually. Additionally, we explored single CVRF to investigate if any of those single factors carry enough information to predict brain changes in these individuals when a pattern classification approach is applied.

Materials and Methods

Study sample

Subjects used in the analysis were described in a previous publication (de Toledo Ferraz Alves et al., 2011). All subjects were recruited from a population sample addressed in an epidemiological research program, the SPAH study (Scazufca et al., 2008).

The inclusion criterion was elderly individuals aged between 66 and 75 years. Exclusion criteria were as follows: (a) presence of dementia or minor cognitive impairment; history of stroke, epilepsy, brain trauma, transitory ischemic events and other neuropsychiatric disorders; and contra-indications for MRI scanning. After MRI acquisition, additional individuals were excluded due to different reasons, as artifacts, presence of silent gross brain lesions identified on the images and individuals for which one or more of the variables needed to generate the FCHDR score were missing. Figure 1 presents this information, where the reasons for exclusions, as well as the number of subjects excluded and their gender distribution were detailed. The study was approved by local ethics committees, and all subjects gave informed written consent.

Figure 1.

Figure 1

Representation of sample selection and exclusion cases. The number and gender (M/F) of each subject excluded from the original sample are presented along with the respective reasons for exclusion.

Table 2 presents demographic and clinical characteristics for the final sample of 164 subjects whose MRI scans were used in the present analyses. For classification, these 164 subjects were divided into three groups: low, medium, and high cardiovascular risk according to their FCHDR score, using the criteria in Table 1 in order to accommodate gender differences.

Table 2.

Demographic and clinical characteristics of the subjects in the sample analyzed.

Low risk (n = 42) Medium risk (n = 65) High risk (n = 57) Statistical test p-Value
Mean age (±SD) in years 70.19 ± 2.26 70.17 ± 2.31 70.63 ± 2.45 ANOVA 0.503
Male/female 9/33 23/42 44/17 χ2 <0.001
Mean years of education (±SD) in years 4.59 ± 3.33 5.14 ± 4.02 3.86 ± 3.31 ANOVA 0.152
APOE_4 allele n (%) 9 (21.43%) 17 (26.15%) 10 (17.54%) χ2 0.516

Genomic DNA was extracted from EDTA-anticoagulated venous blood using a standard salting-out method and its concentration was determined by spectrophotometric measurements. The single nucleotide polymorphisms (SNPs) rs429358 and rs7412 that determine the three APOE isoforms (APOE ε2, APOE ε3, and APOE ε4) were genotyped in two different laboratories. Initially, the genotyping was performed at the laboratory of Genetics and Pharmacogenetics Program at the Institute of Psychiatry, University of Sao Paulo. Then, for quality control, the genotyping was also performed under contract by Prevention Genetics (http://www.preventiongenetics.org). The degree of result discrepancy between the two labs was below 2%.

We report herein the results obtained in the analysis carried out by Prevention Genetics. Positive APOE4 status was considered by the presence of at least one allele ε4 in the genotype (i.e., both heterozygous and homozygous carriers included). In addition, a Hardy–Weinberg equilibrium test was performed and no statistically significant deviation between the loci was observed. In the analyses for the current study, as in the previous investigations by de Toledo Ferraz Alves et al. (2011), we opted for taking into account only the effect of the APOE allele 4. This was due to the fact that the number of subjects was not large enough to address the complexity of the combined effect of APOE alleles 2 and 4.

Brain images: Acquisition and pre-processing

Imaging data were acquired using a 1.5-T GE Sigma scanner (General Electric, Milwaukee WI, USA), according to the following T1-SPGR protocol: (a) a dual-spin-echo sequence of 120 transaxial slices across the entire brain (axial PD/T2); (b) a T2-weighted fast spin-echo transaxial sequence with 88 slices; and (c) a three-dimension gradient echo (Spoiled Gradient Recalled Acquisition–SPGR) sequence of 124 slices with TR/TE of 21.7/5.2 msec, flip angle of 20°, 220 mm field of view (FOV), 1.5 mm slice thickness, number of measures (NEX) of 01, 256 × 192 matrix. All images were visually inspected by an experienced radiologist with the purpose of identifying artifacts and presence of silent gross brain lesions.

After quality inspection, T1 images were pre-processed using DARTEL (Ashburner, 2007). Initially, segmentation was performed in order to generate gray and white matter images of each subject aligned via a rigid-body transformation. After segmentation, templates were created in order to align gray and white matters simultaneously across the images. Finally, images were spatially normalized to MNI space and smoothed using a Gaussian 8 mm FWHM. For this study, we used swc1 images (non-modulated, normalized, and smoothed images) where each voxel intensity represents the probability of containing GM. Before the analysis, we applied a threshold of 0.15 to the GM probability maps (i.e., voxels with less than 15% of probability of containing GM were discarded in all images).

Framingham score and other clinical assessment schedules

The FCHDR is a measure devised to synthesize the combination of different CVRF in order to predict a major vascular-related event (Grundy et al., 1998; Wilson et al., 1998). These CVRF include: age, blood pressure, diabetes mellitus, smoking status, and cholesterol levels (Korf et al., 2004; Lopez et al., 2008; Fitzpatrick et al., 2009; Zivadinov et al., 2009; de Toledo Ferraz Alves et al., 2010; Rasgon et al., 2011).

The clinical tools used to assess the individuals recruited for the study included: measurements of fasting blood glucose levels, with the presence of diabetes mellitus was defined by ≥126 mg/dl and/or current use of insulin or hypoglycemic oral drug treatment; levels of total cholesterol, and high density lipoprotein (HDL), obtained using the cholesterol-oxidase method; and measures of blood pressure, obtained in three measurements using an OMRON digital sphygmomanometer; model HEM-712-C. Individuals with high blood pressure were under antihypertensive treatment. For the calculation of the arterial pressure value, the first measurement was discarded, and the arithmetic mean of the second and third measurements was calculated. Data regarding smoking habits were provided by participant’s answers. More details regarding clinical measurements can be obtained in de Toledo Ferraz Alves et al. (2010) and Tamashiro-Duran et al. (2013).

Pattern recognition

In the present paper, we used machine learning techniques, a branch of artificial intelligence concerned with development of algorithms able to evolve based on empirical data. Machine learning algorithms use examples (data) to capture characteristics of interest from their underlying probability distribution (unknown a priori). Data can be represented as observations (examples) that contain relations among variables (features). In structural neuroimaging, each example is usually a scan (brain volume) from a particular subject and features usually correspond to voxels composing the images (or voxels composing a region of interest anatomically defined). One of the major focuses of machine learning relies on automatic recognizing complex patterns and making decisions based on data (PR). Hence the learner algorithm must generalize from the given examples, as well as to be able to produce an output for new cases not used in the training set.

Classification

One of the most common objectives of PR algorithms in machine learning is classification, which attempts to assign each input value to one of a given set of classes. In neuroimaging, classification approaches have become increasingly popular in clinical research due to their ability to produce individual predictions. In the context of our problem, we hypothesize that the examples (brain scans) of subjects belonging to the low-risk group can be discriminated from the high-risk group with higher accuracy than in classifications involving the medium-risk group.

In general, classification methods work as follows: given a set of training examples, each one known to belong to a specific category (class), the training algorithm learns a function based on the values of each variable in the training set. The decision function learnt is used to classify a new example (i.e., to predict the category to which it belongs) based on to the values of their variables.

In neuroimaging, variables (features) composing the examples usually correspond to voxels derived from a brain scan. Thus, usually each example comprises thousands of features. Although it is not possible to visualize more than three dimensions, mathematically it is possible to conceive a hyperspace where each feature is mapped into a different dimension. In this paper, we applied support-vector machine (SVM) (Boser et al., 1992; Cortes and Vapnik, 1995). The problem of obtaining a decision function in SVM consists in finding a hyperplane (a plane in a hyperspace), which has the largest margin between the closest examples across classes (called support vectors).

Relation between classification projections and FCHDR scores

In the current paper, we performed three binary classifications combining each of the three groups (two by two) (medium versus low risk, high versus medium risk, and high versus low risk). Additionally, as a binary classification may not be enough to define precise predictions in some clinical applications (Sato et al., 2008), we also performed a more exploratory analysis in order to investigate the effect of the degree of cardiovascular risk (treated as a continuous measure) in classifying the groups (categorical information).

According to Sato et al. (2008), in many clinical applications, a continuous index can be more informative than categorical labels, as the distance from the classification boundary reflects prediction reliability. These authors mention the example of AD studies in which two groups of subjects (healthy subjects and patients) are considered. In this case, it would be reasonable to expect that the cognitive effects may vary across subjects; depending on the disease stage (degree of dementia), similar levels of cognitive performance might be present in some of the healthy subjects. In these cases, a continuous variable representing the mental condition of a subject might be considered.

Sato et al. (2008) take into account the fact that there are intermediate observations (a group transition), so that categorical observations might be localized in a continuum between two groups. To illustrate this idea, they apply the maximum uncertainty linear discriminant analysis approach (MLDA) hyperplane navigation (Thomaz et al., 2006), specifying a procedure to project multi-dimensional observations from different groups (categorical label) into a continuum space, obtaining a score to measure the distance of new observations to each group. This score is afterward correlated to the real continual values (in their case, age in a group of healthy subjects performing a motor task in fMRI).

Considering the idea explained above, we performed in the present study a correlation analysis of the projection of the samples in the hyperplane with their FCHDR scores. The rationale is to evaluate the link between brain image patterns and cardiovascular risk information, based on the assumption that, in general, the more extreme the risk, the further the sample would be distant from the decision boundary.

Regression

For classification analysis, subjects were categorized in three groups according to their FCHDR scores. Although classification is the most common PR approach used in neuroimaging, machine learning techniques can also be applied to non-categorical data through regression methods. This approach has great potential to be applied in clinical researches involving continuous data (e.g. population or physiological data, behavioral tests results, etc). In this paper, we used support-vector regression [SVR (Drucker et al., 1997; Smola and Schölkopf, 1998)], an algorithm similar to SVM for classification, nevertheless applying different parameterization. Instead of predicting a category to which an example belongs, the objective here is to predict the clinical measure itself. Figure 2 shows a representation summarizing both the classification and regression analyses presented in this paper.

Figure 2.

Figure 2

Representation of classification and regression analysis described along the paper.

The predictors for the analysis of single risk factors were normalized (i.e., the mean value was subtracted from the original values and results were divided by the SD). The normalization enabled comparison of mean square errors (MSE) among different single risk factors, as they were originally represented through different measure units. MSE measures the average of the square errors (i.e., the amount by which the value implied by the estimator differs from the quantity to be estimated). Both classification and regression methods were implemented using LIBSVM library1.

Cross-validation framework

Cross-validation is a technique used to assess how the results of a statistical analysis will generalize to an independent data set. One round of cross-validation involves partitioning a data sample into disjoint subsets of examples, performing the analysis on one subset (the training set), and validating the analysis on the other subset (the validation set or testing set).

To reduce the variability, multiple rounds of cross-validation are performed using different partitions, and the validation results are averaged over the rounds. In the present study, we implemented a leave-one-out cross-validation (LOO-CV), which involves separating a single example from the original sample for validation while the remaining examples are used as the training dataset. This splitting is repeated in order that each example in the sample is used once as the validation data. After repeating this process leaving out all examples, the final accuracy was quantified as the average of accuracies obtained across all iterations. In classification, we left out one pair of examples (i.e., one subject from each group) in each round so that the analysis was balanced between the two groups. For regression analysis, one single subject was left out at each round, as the objective is not a classification between two groups.

Statistical significance testing

We implemented permutation tests to evaluate whether the results were statistically significant. This approach is a non-parametric statistical test in which the distribution of the test under the null hypothesis is obtained by calculating many possible combinations under rearrangements of the labels (e.g., categories or clinical values) across the examples. It consists in randomly exchanging the labels associated to the examples and repeating the complete procedure a high number of times (e.g., 1000). As the correlations between examples and labels are destroyed due to the labels’ permutation, one expects the classification accuracy to be close to chance (around 50%).

The significance level is given by the number of times for which the accuracy obtained from analysis with permuted labels is higher than the accuracy obtained in the original analysis. The resulting number is divided by the number of repetitions to provide a proportion value. The same approach is applied to regression, considering the correlation between real, and predicted labels instead of accuracy.

Results

Classification of risk groups categorized according to FCHDR scores

As described in section “Study Sample,” we divided the individuals in three groups (low, medium, and high cardiovascular risk) according to their FCHDR scores. In order to deal with unbalance issues, we matched subjects by gender and age. This is important to keep generalization ability, particularly in a cross-validation approach. After matching subjects, we performed three binary classifications: low versus medium risk (84 subjects), medium versus high risk (74 subjects), and low versus high risk (44 subjects).

Given that the Framingham score takes into account age and gender, we tried an alternative approach, considering all subjects without matching. However, because of the different number of subjects in each group, randomness was applied in the cross-validation in order to select repeated subjects in the group with less subjects. Using this approach, average accuracy was slightly better, but there was a loss in generalization ability.

All the analyses were performed taking into account genetic information regarding APOE-4 allele carriers (data used as a covariate). In order to control for this effect, we applied a removal of confound effects on the kernels using a residual form matrix, as described in Chu et al. (2011).

Support-vector machine applied to classifications involving the medium-risk group (i.e., low versus medium risk and medium versus high risk) did not produce statistically significant results according to the permutation tests. Accuracies of both analyses were close to chance (Table 3), meaning that the classifiers were not able to discriminate these groups. However, it was possible to discriminate extreme groups (high versus low risk) with 75% accuracy. The sensitivity (i.e., the proportion of individuals from high-risk group correctly classified) was 82% and the specificity (i.e., the proportion of individuals from low-risk group correctly classified) was 68%. Permutation test showed this result was significant (p < 0.0001). Table 3 presents results from the three binary classifiers.

Table 3.

Results from SVM classification considering the three risk groups in binary combinations.

Groups Sensitivity (%) Specificity (%) Accuracy (%) Statistical significance
Medium × low risk 38.10 59.52 48.81 ≤0.6390
High × medium risk 62.16 43.24 52.70 ≤0.3490
High × low risk 81.82 68.18 75 ≤0.0001

Regarding the additional analysis described in sub-section “Relation between classification projections and FCHDR scores” above, the Pearson correlation value between FCHDR scores and SVM projections in the classification between high and low-risk groups was 0.788 (p ≤ 0.0001). The same correlation for the classifications involving the medium-risk group were 0.559 (p ≤ 0.0002) for high versus medium risk, and 0.609 (p ≤ 0.0001) for medium versus low risk.

Figure 3 presents three panels illustrating SVM classification projections and correlation of these projections with FCHDR for the three binary classifications – (A) low versus high risk; (B) low versus middle risk; and (C) middle versus high risk.

Figure 3.

Figure 3

Each panel presents SVM projections resulting from a binary classification: (A) Low versus medium risk; (B) Medium versus high risk; (C) Low versus high risk. On the left-hand side in each panel, the plot shows the classification projection in colors representing the real class of each subject. As a convention, in each classification, the lower risk class was labeled with −1 and the higher class was labeled as 1. Thus, subjects with negative projections are classified as belonging to the lower risk class and subjects with positive projections are classified as belonging to the higher risk class. From these plots, it is possible to notice that the numbers of correct classifications in (A,B) are very close to chance. In (C), it is possible to notice that most low-risk subjects have negative projections and most high-risk subjects have positive projections (which results in the accuracy of 75% described in Section “Classification of Risk Groups Categorized According to FCHDR Scores.” Nevertheless, for all classifications there was significant correlation between SVM projections and FCHDR for the subjects correctly classified (illustrated in the plots on the right-hand side in each panel).

Regression analysis

In this section, we present results of the regression analysis without categorization in risk groups, since we are interested in evaluating how accurately we can predict cardiovascular risk from brain patterns. For regression, we also used a cross-validation framework. However, only one subject is left out for test in each iteration (instead of one pair of subjects), as we are not comparing groups (classes) of individuals. We start using FCHDR scores as targets for regression. Next, in a more exploratory investigation we analyze risk factors that contribute to the FCHDR score computation (diabetes, blood pressure, age, cholesterol, and smoking status) in order to evaluate if there are factors that stand out as more predictable from the brain patterns. Additionally, we analyze data from male and female subjects separately, as differences in gender have been reported in related literature (Perneczky et al., 2007; Hsu et al., 2008; Ystad et al., 2009; Andersen et al., 2010; Takahashi et al., 2011; Yao et al., 2012; Hall et al., 2013).

All subjects

The result of the correlation between real FCHDR and predicted values was 0.2481 (p < 0.001) with MSE 1.0564 (p < 0.001). In Figure 4, a scatter plot represents this correlation, where each subject is plotted with real FCHDR score placed in the x-axes and predicted score placed in the y-axes. Individuals were plotted in different colors according to gender. The color coding offers an initial insight regarding the existence of gender differences in relation to the association of brain patterns to CVRF.

Figure 4.

Figure 4

Scatter plot of correlation between real and predicted FCHDR score codified in colors according to the gender. Please notice that this analysis was performed considering all subjects (male and female). The colors code (red for female and blue for male) was used in order to provide a better visualization regarding the gender difference observed in the results.

Besides the application of SVR to learn relations between brain patterns and the combined measure of cardiovascular risks (FCHDR score), we also evaluated whether it is possible to predict single risk factors from relations learned from brain patterns. Results are presented in Table 4. No single factor presented significant results of the correlation between real and predicted variable. As regards dichotomic diabetes (derived from glycemia), we applied classification to evaluate whether is possible to discriminate diabetic and non-diabetic individuals. Like the other single risk factors, results for diabetes were not significant (classification accuracy = 55%, p = 0.22).

Table 4.

Regression with single risk factors.

R p(R) MSE p(MSE)
FCHDR 0.2481 <0.001 1.0564 <0.001
Blood pressure 0.0753 0.215 1.1498 0.216
Age 0.0052 0.424 1.2408 0.517
Total cholesterol −0.0212 0.529 1.3400 0.821
LDL cholesterol −0.0475 0.642 1.3417 0.822
Smoking status 0.1628 0.057 1.0698 0.067

R is the correlation between real and predicted values and MSE is the mean squared error. The statistical significance (p) was estimated for both R and MSE.

Gender differences

Figure 4 suggests that there is a potential difference in the ability of predicting FCHDR from brain patterns according to gender. As the FCHDR score was devised through different calculation for male and female individuals (see Study Sample), we also performed the regression analysis separately for male and female individuals. The correlation between real and predicted FCHDR scores in females was 0.4044 (p < 0.001). However, in males this correlation was not significant.

Table 5 presents results of analyses performed separately in females and males. For females, age and smoking status could be predicted from brain patterns. Blood pressure also stood out, but the statistical significance of its accuracy was slightly above the considered threshold of 0.05. For males, no single factor could be predicted (Table 5).

Table 5.

Regression with single risk factors.

R p(R) MSE p(MSE) R p(R) MSE p(MSE)
FCHDR 0.4044 <0.001 0.8323 <0.001 −0.0057 0.424 1.1999 0.580
Blood pressure 0.2309 0.054 0.9685 0.052 −0.1945 0.850 1.3054 0.818
Age 0.2776 0.033 0.9379 0.035 0.1182 0.201 1.0267 0.136
Total cholesterol −0.0478 0.540 1.1960 0.504 −0.0177 0.441 1.2608 0.702
LDL cholesterol −0.1264 0.755 1.2691 0.725 −0.0376 0.480 1.2206 0.605
Smoking status 0.3480 0.008 0.8705 0.007 −0.0894 0.633 1.2826 0.780

R is the correlation between real and predicted values and MSE is the mean squared error. Statistical significance (p) was estimated for both R and MSE. These analyses were performed separately in females (left in the table) and males (right).

APOE 4 allele differences

The presence of APOE 4 allele is associated with an increased risk not only for dementia but also for cardiovascular disease. Therefore, the APOE-4 allele carrier can be a confound factor for the analyses. It is important to evaluate if the correlation between real and predicted FCHDR scores remains significant if the APOE genotyping is included in the model as a covariate. In the analyses performed using all subjects (males and females), the results retained significance for FCHDR score (r = 0.1961, p = 0.007). Regarding the analysis performed only with female individuals, both FCHDR score and age retained significance when the genetic data was included as covariate in the model.

Regression analysis in APOE4 carriers and non-carriers separately

In our database, 36 individuals carry at least one APOE-4 allele. We selected a group consisting of 36 non-allele 4 carriers from the same database matching according to gender, age, and FCHDR score. We performed regression analysis separately for carriers and non-carriers using FCHDR as target. The correlation between real and predicted FCHDR was 0.4240 (p = 0.003) for carriers and 0.2937 (p = 0.041) for non-carriers.

Figure 5 presents a map of the relative weights of each voxel resulting from regression of brain patterns using FCHDR scores as targets in the analyses performed with carriers (Figure 5A) and non-carriers (Figure 5B).

Figure 5.

Figure 5

Map showing the relative weight of each voxel in the multivariate regression (SVR) of images using FCHDR scores as targets. Separate analysis was performed for APOE4 allele carriers (A) and non-carriers (B).

Regarding the map, it is important to observe that due to the fact that the analysis is multivariate, the combination of all voxels is identified as a global spatial pattern by which the groups differ (i.e., the discriminating pattern). As all voxels contribute to the classification in some degree, it is not appropriate to make regional inferences based on single voxels or regions separately from the rest of the pattern.

Discussion

Recent literature on neuroscience related to aging processes has shown increasing evidence of the impact of CVRF on cognitive performance (Launer et al., 2000; Knopman et al., 2001; Korf et al., 2004; Stuerenburg et al., 2005; Irie et al., 2008; Lopez et al., 2008; Erkinjuntti and Gauthier, 2009; Fitzpatrick et al., 2009; Zivadinov et al., 2009; Rasgon et al., 2011; Rouch et al., 2012; Watts et al., 2013). Recent studies have also applied neuroimaging resources in order to show that structural brain changes (e.g., GM loss) are associated to different CVRF (e.g., glycemia level, blood pressure, age, cholesterol levels), separately or in composite measures (Xu et al., 2009; Glodzik et al., 2012).

In the present paper, we aimed to decode cardiovascular risk information from image patterns. In our context, decoding models (or recognition models) related changes in brain pattern (independent variable) to CVRF (dependent variable).

Multivariate approaches can reveal information jointly encoded by all features considered (as a network). Additionally, they can provide predictions in individual level. To the best of our knowledge, this is the first study using PR techniques to investigate the effect of CVRF on the brain based on structural MRI. We hypothesize that brain changes caused by a combination of CVRF risks encompass different brain regions. Thus methods that take into account the joint effect of all voxels in the whole brain can be more sensitive to detect changes than univariate methods.

In the classification of groups categorized according to FCHDR scores, it was possible to discriminate the extreme groups (low versus high risk) with statistical significance. However, it should be noted that the indices of diagnostic accuracy obtained were considerably more modest than the accuracy levels found in studies of AD or minor cognitive impairment (Fan et al., 2008; Cui et al., 2011; Davatzikos et al., 2011; Diciotti et al., 2012; Westman et al., 2012). This provides indication that the impact of CVRF in the cognitively preserved elderly population is subtle, even when one applies multivariate statistical approaches of improved sensitivity such as the one employed herein. Regarding the medium group risk, classification in relation to both low and high-risk groups resulted in lower accuracy levels and permutation tests showed these results were not statistically significant. This again underscores the subtlety of the impact of CVRF on brain volumes in cognitively preserved elderly individuals. Medium-risk individuals presented a higher homogeneity in their brain patterns, and this may have prevented their discrimination from the extreme (low and high) risk groups.

This hypothesis is reinforced by the difference in the number of subjects correctly classified in each group in the above mentioned analyses. In high versus medium risk, 62% of the high-risk subjects were correctly classified compared to 43.24% in the medium-risk group. In the same way, in medium versus low risk, 38.10% of the medium-risk subjects were correctly classified and compared to 59.52% in the low-risk group. By correlating FCHDR rates of subjects correctly classified to their respective classification projections, it was possible to observe this inhomogeneity in the asymmetry of projections in Figures 3A,B.

The above findings provide indication that the images from subjects categorized in three groups apparently are not homogeneous enough to discriminate intermediate subjects (medium risk) from low and high-risk subjects. Conversely, given the fact that the correlation between FCHDR rates with their classification projections is high and significant for the three comparisons, our data also indicate that the patterns carry relevant, continuous information regarding the impact of cardiovascular risk on the brain.

Complementary to the classification based on categorized groups, we applied multivariate regression to the complete dataset (without categorization) in order to decode continuous measures from the brain images. This analysis aimed at investigating to what degree brain changes associated to cardiovascular risk are detectable from structural MRI. Using SVR (Support-Vector Regression), parameters were learned from the training subjects’ images. These parameters were used to predict a continuous value for the test subject. Applying SVR in a LOO-CV framework produced a set of predicted values, which was correlated with the set of real values. This correlation was evaluated regarding statistical significance using permutation tests.

Through SVR analysis considering all subjects (both male and female), it was possible to predict the FCHDR score with high statistical significance (p < 0.001). This result suggests that anatomical brain changes detectable from MRI images seem to clearly reflect different levels of cardiovascular risk given by the Framingham score. On the other hand, by exploring each risk factor isolated (diabetes, blood pressure, age, total cholesterol, and smoking status), none of them presented significant correlation between real and predicted values. Thus, the SVR analysis allowed us to empirically confirm that brain volume variations predict best the combined influence of different CVRF (as assessed with Framingham scores), rather than by any of the single factors when considered in isolation.

Results of the analyses performed separately in men and women were remarkably different. The correlation between real and predicted FCHDR scores in females was much higher than the correlation obtained when considering the entire population. Additionally, this correlation was not significant when males were considered separately. This is interesting in light of the fact that clinical and epidemiological studies strongly indicate that the prevalence is greater and the outcome is poorer for cardio- and cerebro-vascular disorders in males (Grundy and Jett, 1959; Plavinskaia and Shestov, 1991; Kameneva et al., 2003; Khaksari et al., 2005; Moran et al., 2008). Although gender differences have already been reported in previous studies, the magnitude of these differences in our results suggest that future investigations need to be carried out in order to afford a better understanding of their fundamental basis. However, the gender imbalance in our dataset may contribute for this effect, as men predominate in high-risk group. There was an excess of males from our overall epidemiological cohort that could not be included since previous phases of the investigation due to overt neurological and cerebrovascular-related diseases. Therefore, it is likely that our study design privileged the inclusion of a sub-sample of males with high cardiovascular risk that is less representative of the general elderly population, and this would have exerted an impact on the statistical significance of our findings for males.

When exploring single risk factors in females separately, it was interesting to observe that although two single risk factors (age and smoking status) were significantly predicted, only age remained significant when including the genetic risk factor (the APOE4 allele) as covariate in the model. This finding corroborates once again the importance of considering cardiovascular risks factors jointly when studying their effects on structural brain changes.

Albeit statistically significant, the correlation rates between actual FCHDR scores and values predicted from regression were modest (r = 0.2481when considering both male and female together, and r = 0.4044 when considering only female subjects). Although in the literature, there are examples where this correlation is very high (e.g., r = 0.92 in decoding age from structural MRI from healthy individuals, Franke et al., 2010), there are also examples of applications where the decoding affords low correlations, although still significant (ex. r = 0.49 to predict years from onset in Huntington disease, Rizk-Jackson et al., 2011). In our investigation, we are searching for brain alterations due to cardiovascular risk that are presumably subtle, in individuals that are unaffected by neurological or psychiatric disorders and cognitively unimpaired. Although there is evidence in the previous literature suggesting that the individuals with higher FCHDR are more likely to develop AD in the future, it should be noted that at the time the individuals are scanned in our study design, they do not present any symptoms. We believe that the nature of this decoding plays a role in explaining why the correlation between the real and predicted values is not as high as they could be if we were investigating patients actually suffering from dementia.

The results of analyses taking into account the presence of the APOE 4 allele suggest the impact of this genetic variation on brain volumes. This is consistent with the findings of a number of previous MRI studies (Yasuda et al., 1998; Hashimoto et al., 2001; Lind et al., 2006; Crivello et al., 2010; Liu et al., 2010; Fennema-Notestine et al., 2011; Lu et al., 2011; Bender and Raz, 2012; Bunce et al., 2012; O’Dwyer et al., 2012; Dowell et al., 2013). It is interesting that the analysis showed different signatures for CVRF-related brain variations in APOE-4 allele carriers and non-carriers. A similar difference had already been shown in previous MRI and PET studies that used univariate image analysis methods (Kuller, 2003; Zipser et al., 2007; Deeny et al., 2012; Lo and Jagust, 2012), but this had never been previously demonstrated using the multivariate PR approach as shown herein. Additionally, it is interesting to notice that although analysis in APOE 4 carriers showed higher correlation between real and predicted FCHDR (indicating that the presence of the APOE 4 allele modulates the influence of CVRF on regional brain volumes), the correlation obtained from analysis with non-carriers was also significant. This result reinforces the initial hypothesis that CVRF of non-genetic origin also lead to detectable brain changes.

Regarding localization of brain alterations, caution must be exercised when drawing conclusions in regard to the description of the brain regions that contribute to each of the discriminative patterns reported herein. Although the maps enable to visualize the relative relevance of each voxel in predicting the labels, these predictions depend on the whole pattern, so it is not possible to assign results to single brain regions.

In conclusion, our results endorse the suggestion that the severity of the Framingham score for combined cardiovascular risk is related to brain volume changes detectable through global patterns from structural MRI data, when a pattern classification approach is applied. Additionally, these brain changes seem to be actually modulated by the presence of the APOE 4 allele but remain detectable when this genetic variable is included in the models as a covariate, suggesting that environmental factors and other genetic influences also play an important role in the emergence of brain changes associated to the degree of cardiovascular risk. The discrimination between individuals with low and high cardiovascular risk hints at a potential clinical usefulness of pattern classification methods to assess the impact of CVRF on the brain on an individual basis. It is important that further studies are conducted to confirm this possibility, given that CVRF are preventable and modifiable, and so are likely to be their effects on the brain.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors thank the reviewers for the valuable comments and input provided. This work was supported by the Coordination for the Improvement of Higher Education Personnel (CAPES), reference number 3883-11-6; the National Council for Scientific and Technological Development (CNPq), reference numbers 165788/2013-5 and 303819/2012-0 and São Paulo Research Foundation (FAPESP), reference numbers 2012/50239-6, 2013/03231-3 and 04/15336-5.

Footnotes

1Chih-Chung Chang and Chih-Jen Lin, LIBSVM: a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm/

References

  1. Aksu Y., Kesidis G., Bigler D. C., Yang Q. X. (2011). An MRI-derived definition of MCI-to-AD conversion for long-term, automatic prognosis of MCI patients. PLoS ONE 6:e20574. 10.1371/journal.pone.0025074 [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Almeida O. P., Garrido G. J., Lautenschlager N. T., Hulse G. K., Jamrozik K., Flicker L. (2008). Smoking is associated with reduced cortical regional gray matter density in brain regions associated with incipient Alzheimer disease. Am. J. Geriatr. Psychiatry 16, 92–98. 10.1097/JGP.0b013e318157cad2 [DOI] [PubMed] [Google Scholar]
  3. Andersen K. K., Andersen Z. J., Olsen T. S. (2010). Age- and gender-specific prevalence of cardiovascular risk factors in 40,102 patients with first-ever ischemic stroke: a Nationwide Danish Study. Stroke 41, 2768–2774. 10.1161/STROKEAHA.110.595785 [DOI] [PubMed] [Google Scholar]
  4. Ashburner J. (2007). A fast diffeomorphic image registration algorithm. Neuroimage 38, 95–113 10.1016/j.neuroimage.2007.07.007 [DOI] [PubMed] [Google Scholar]
  5. Ashburner J., Friston K. J. (2000). Voxel-based morphometry – the methods. Neuroimage 11(6 Pt 1), 805–821 10.1016/S1053-8119(00)91734-8 [DOI] [PubMed] [Google Scholar]
  6. Beauchet O., Celle S., Roche F., Bartha R., Montero-Odasso M., Allali G., et al. (2013). Blood pressure levels and brain volume reduction: a systematic review and meta-analysis. J. Hypertens. 31, 1502–1516. 10.1097/HJH.0b013e32836184b5 [DOI] [PubMed] [Google Scholar]
  7. Bender A. R., Raz N. (2012). Age-related differences in memory and executive functions in healthy APOE varepsilon4 carriers: the contribution of individual differences in prefrontal volumes and systolic blood pressure. Neuropsychologia 50, 704–714. 10.1016/j.neuropsychologia.2011.12.025 [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Boser B. E., Guyon I. M., Vapnik V. N. (1992). “A training algorithm for optimal margin classifiers,” in 5th Annual ACM Workshop (Pittsburgh, PA: ACM Press; ), 144152. [Google Scholar]
  9. Buchman A. S., Boyle P. A., Yu L., Shah R. C., Wilson R. S., Bennett D. A. (2012). Total daily physical activity and the risk of AD and cognitive decline in older adults. Neurology 78, 1323–1329 10.1212/WNL.0b013e31824367c2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Bunce D., Anstey K., Cherbuin N., Gautam P., Sachdev P., Easteal S. (2012). APOE genotype and entorhinal cortex volume in non-demented community-dwelling adults in midlife and early old age. J. Alzheimers Dis. 30, 935–942. 10.3233/JAD-2012-112126 [DOI] [PubMed] [Google Scholar]
  11. Chen X., Wen W., Anstey K. J., Sachdev P. S. (2006). Effects of cerebrovascular risk factors on gray matter volume in adults aged 60-64 years: a voxel-based morphometric study. Psychiatry Res. 147, 105–114. 10.1016/j.pscychresns.2006.01.009 [DOI] [PubMed] [Google Scholar]
  12. Chen Z., Li L., Sun J., Ma L. (2012). Mapping the brain in type II diabetes: voxel-based morphometry using DARTEL. Eur. J. Radiol. 81, 1870–1876. 10.1016/j.ejrad.2011.04.025 [DOI] [PubMed] [Google Scholar]
  13. Cherbuin N., Anstey K. J., Sachdev P. S., Maller J. J., Meslin C., Mack H. A., et al. (2008). Total and regional gray matter volume is not related to APOE*E4 status in a community sample of middle-aged individuals. J. Gerontol. A Biol. Sci. Med. Sci. 63, 501–504. 10.1093/gerona/63.5.501 [DOI] [PubMed] [Google Scholar]
  14. Chetelat G., Desgranges B., de la Sayette V., Viader F., Berkouk K., Landeau B., et al. (2003). Dissociating atrophy and hypometabolism impact on episodic memory in mild cognitive impairment. Brain 126(Pt 9), 1955–1967. 10.1093/brain/awg196 [DOI] [PubMed] [Google Scholar]
  15. Chincarini A., Bosco P., Calvini P., Gemme G., Esposito M., Olivieri C., et al. (2011). Local MRI analysis approach in the diagnosis of early and prodromal Alzheimer’s disease. Neuroimage 58, 469–480. 10.1016/j.neuroimage.2011.05.083 [DOI] [PubMed] [Google Scholar]
  16. Chu C., Ni Y., Tan G., Saunders C. J., Ashburner J. (2011). Kernel regression for fMRI pattern prediction. Neuroimage 56, 662–673. 10.1016/j.neuroimage.2010.03.058 [DOI] [PMC free article] [PubMed] [Google Scholar]
  17. Cortes C., Vapnik V. (1995). Support-vector network. Mach. Learn. 20, 273–297 10.1023/A:1022627411411 [DOI] [Google Scholar]
  18. Crivello F., Lemaître H., Dufouil C., Grassiot B., Delcroix N., Tzourio-Mazoyer N., et al. (2010). Effects of ApoE-epsilon4 allele load and age on the rates of grey matter and hippocampal volumes loss in a longitudinal cohort of 1186 healthy elderly persons. Neuroimage 53, 1064–1069. 10.1016/j.neuroimage.2009.12.116 [DOI] [PubMed] [Google Scholar]
  19. Cui Y., Liu B., Luo S., Zhen X., Fan M., Liu T., et al. (2011). Identification of conversion from mild cognitive impairment to Alzheimer’s disease using multivariate predictors. PLoS ONE 6:e21896. 10.1371/journal.pone.0021896 [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Dai Z., Yan C., Wang Z., Wang J., Xia M., Li K., et al. (2012). Discriminative analysis of early Alzheimer’s disease using multimodal imaging and multi-level characterization with multi-classifier (M3). Neuroimage 59, 2187–2195. 10.1016/j.neuroimage.2011.10.003 [DOI] [PubMed] [Google Scholar]
  21. Davatzikos C., Bhatt P., Shaw L. M., Batmanghelich K. N., Trojanowski J. Q. (2011). Prediction of MCI to AD conversion, via MRI, CSF biomarkers, and pattern classification. Neurobiol. Aging 32, e2319–e2327. 10.1016/j.neurobiolaging.2010.05.023 [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. de Toledo Ferraz Alves T. C., Ferreira L. K., Wajngarten M., Busatto G. F. (2010). Cardiac disorders as risk factors for Alzheimer’s disease. J. Alzheimers Dis. 20, 749–763. 10.3233/JAD-2010-091561 [DOI] [PubMed] [Google Scholar]
  23. de Toledo Ferraz Alves T. C., Scazufca M., Squarzoni P., de Souza Duran F. L., Tamashiro-Duran J. H., Vallada H. P., et al. (2011). Subtle gray matter changes in temporo-parietal cortex associated with cardiovascular risk factors. J. Alzheimers Dis. 27, 575–589. 10.3233/JAD-2011-110827 [DOI] [PubMed] [Google Scholar]
  24. DeCarli C., Massaro J., Harvey D., Hald J., Tullberg M., Au R., et al. (2005). Measures of brain morphology and infarction in the framingham heart study: establishing what is normal. Neurobiol. Aging 26, 491–510. 10.1016/j.neurobiolaging.2004.05.004 [DOI] [PubMed] [Google Scholar]
  25. Deeny S. P., Winchester J., Nichol K., Roth S. M., Wu J. C., Dick M., et al. (2012). Cardiovascular fitness is associated with altered cortical glucose metabolism during working memory in varepsilon4 carriers. Alzheimers Dement. 8, 352–356. 10.1016/j.jalz.2011.04.010 [DOI] [PMC free article] [PubMed] [Google Scholar]
  26. Diciotti S., Ginestroni A., Bessi V., Giannelli M., Tessa C., Bracco L., et al. (2012). Identification of mild Alzheimer’s disease through automated classification of structural MRI features. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2012, 428–431. 10.1109/EMBC.2012.6345959 [DOI] [PubMed] [Google Scholar]
  27. Dowell N. G., Ruest T., Evans S. L., King S. L., Tabet N., Tofts P. S., et al. (2013). MRI of carriers of the apolipoprotein E e4 allele-evidence for structural differences in normal-appearing brain tissue in e4+ relative to e4-young adults. NMR. Biomed. 26, 674–682. 10.1002/nbm.2912 [DOI] [PubMed] [Google Scholar]
  28. Drucker H., Burges C. J. C., Kaufman L., Smola A. J., Vapnik V. (1997). “Support vector regression machines,” in Proceedings from the Conference Neural Information Processing Systems (NIPS 96) eds Mozer M. C., Jordan M. I., Petsche T. (Denver: MIT Press), 155–161. [Google Scholar]
  29. Elias M. F., Elias P. K., Sullivan L. M., Wolf P. A., D’Agostino R. B. (2003). Lower cognitive function in the presence of obesity and hypertension: the Framingham heart study. Int. J. Obes. Relat. Metab. Disord. 27, 260–268. 10.1038/sj.ijo.802225 [DOI] [PubMed] [Google Scholar]
  30. Erkinjuntti T., Gauthier S. (2009). The concept of vascular cognitive impairment. Front. Neurol. Neurosci. 24:79–85 10.1159/000197886 [DOI] [PubMed] [Google Scholar]
  31. Fan Y., Resnick S. M., Wu X., Davatzikos C. (2008). Structural and functional biomarkers of prodromal Alzheimer’s disease: a high-dimensional pattern classification study. Neuroimage 41, 277–285. 10.1016/j.neuroimage.2008.02.043 [DOI] [PMC free article] [PubMed] [Google Scholar]
  32. Fennema-Notestine C., Panizzon M. S., Thompson W. R., Chen C. H., Eyler L. T., Fischl B., et al. (2011). Presence of ApoE epsilon4 allele associated with thinner frontal cortex in middle age. J. Alzheimers Dis. 26(Suppl. 3), 49–60. 10.3233/JAD-2011-0002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Fitzpatrick A. L., Kuller L. H., Lopez O. L., Diehr P., O’Meara E. S., Longstreth W. T., Jr., et al. (2009). Midlife and late-life obesity and the risk of dementia: cardiovascular health study. Arch. Neurol. 66, 336–342. 10.1001/archneurol.2008.582 [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Franke K., Ziegler G., Klöppel S., Gaser C., Alzheimer’s Disease Neuroimaging Initiative . (2010). Estimating the age of healthy subjects from T1-weighted MRI scans using kernel methods: exploring the influence of various parameters. Neuroimage 50, 883–892. 10.1016/j.neuroimage.2010.01.005 [DOI] [PubMed] [Google Scholar]
  35. Garrido G. E., Furuie S. S., Buchpiguel C. A., Bottino C. M., Almeida O. P., Cid C. G., et al. (2002). Relation between medial temporal atrophy and functional brain activity during memory processing in Alzheimer’s disease: a combined MRI and SPECT study. J. Neurol. Neurosurg. Psychiatr. 73, 508–516. 10.1136/jnnp.73.5.508 [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. Glodzik L., Mosconi L., Tsui W., de Santi S., Zinkowski R., Pirraglia E., et al. (2012). Alzheimer’s disease markers, hypertension, and gray matter damage in normal elderly. Neurobiol. Aging 33, 1215–1227. 10.1016/j.neurobiolaging.2011.02.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Grundy S. M., Balady G. J., Criqui M. H., Fletcher G., Greenland P., Hiratzka L. F., et al. (1998). Primary prevention of coronary heart disease: guidance from Framingham: a statement for healthcare professionals from the AHA Task Force on Risk Reduction. American Heart Association. Circulation 97, 1876–1887 10.1161/01.CIR.97.18.1876 [DOI] [PubMed] [Google Scholar]
  38. Grundy S. M., Jett J. D. (1959). Incidence of various types of cardiovascular diseases by age group in the male and in the female. J. Am. Geriatr. Soc. 7, 16–37. [DOI] [PubMed] [Google Scholar]
  39. Hall J. R., Wiechmann A. R., Johnson L. A., Edwards M., Barber R. C., Winter A. S., et al. (2013). Biomarkers of vascular risk, systemic inflammation, and microvascular pathology and neuropsychiatric symptoms in Alzheimer’s disease. J. Alzheimers Dis. 35, 363–371. 10.3233/JAD-122359 [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Hashimoto M., Yasuda M., Tanimukai S., Matsui M., Hirono N., Kazui H., et al. (2001). Apolipoprotein E epsilon 4 and the pattern of regional brain atrophy in Alzheimer’s disease. Neurology 57, 1461–1466. 10.1212/WNL.57.8.1461 [DOI] [PubMed] [Google Scholar]
  41. Hsu J. L., Leemans A., Bai C. H., Lee C. H., Tsai Y. F., Chiu H. C., et al. (2008). Gender differences and age-related white matter changes of the human brain: a diffusion tensor imaging study. Neuroimage 39, 566–577. 10.1016/j.neuroimage.2007.09.017 [DOI] [PubMed] [Google Scholar]
  42. Irie F., Fitzpatrick A. L., Lopez O. L., Kuller L. H., Peila R., Newman A. B., et al. (2008). Enhanced risk for Alzheimer disease in persons with type 2 diabetes and APOE epsilon4: the Cardiovascular Health Study Cognition Study. Arch. Neurol. 65, 89–93. 10.1001/archneurol.2007.29 [DOI] [PMC free article] [PubMed] [Google Scholar]
  43. Jagust W. (2006). Positron emission tomography and magnetic resonance imaging in the diagnosis and prediction of dementia. Alzheimers Dement. 2, 36–42. 10.1016/j.jalz.2005.11.002 [DOI] [PubMed] [Google Scholar]
  44. Jeerakathil T., Wolf P. A., Beiser A., Massaro J., Seshadri S., D’Agostino R. B., et al. (2004). Stroke risk profile predicts white matter hyperintensity volume: the Framingham Study. Stroke 35, 1857–1861. 10.1161/01.STR.0000131809.35202.1b [DOI] [PubMed] [Google Scholar]
  45. Kameneva M. V., Watach M. J., Borovetz H. S. (2003). Rheologic dissimilarities in female and male blood: potential link to development of cardiovascular diseases. Adv. Exp. Med. Biol. 530, 689–696. 10.1007/978-1-4615-0075-9_69 [DOI] [PubMed] [Google Scholar]
  46. Kawachi T., Ishii K., Sakamoto S., Sasaki M., Mori T., Yamashita F., et al. (2006). Comparison of the diagnostic performance of FDG-PET and VBM-MRI in very mild Alzheimer’s disease. Eur. J. Nucl. Med. Mol. Imaging 33, 801–809. 10.1007/s00259-005-0050-x [DOI] [PubMed] [Google Scholar]
  47. Khaksari M., Mahmoodi M., Rezvani M. E., Sajjadi M. A., Karam G. A., Hajizadeh S. (2005). Differences between male and female students in cardiovascular and endocrine responses to examination stress. J. Ayub Med. Coll. Abbottabad 17, 15–19. [PubMed] [Google Scholar]
  48. Kivipelto M., Rovio S., Ngandu T., Kåreholt I., Eskelinen M., Winblad B., et al. (2008). Apolipoprotein E epsilon4 magnifies lifestyle risks for dementia: a population-based study. J. Cell. Mol. Med. 12, 2762–2771. 10.1111/j.1582-4934.2008.00296.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  49. Knopman D., Boland L. L., Mosley T., Howard G., Liao D., Szklo M., et al. (2001). Cardiovascular risk factors and cognitive decline in middle-aged adults. Neurology 56, 42–48. 10.1212/WNL.56.1.42 [DOI] [PubMed] [Google Scholar]
  50. Korf E. S., van Straaten E. C., de Leeuw F. E., van der Flier W. M., Barkhof F., Pantoni L., et al. (2007). Diabetes mellitus, hypertension and medial temporal lobe atrophy: the LADIS study. Diabet. Med. 24, 166–171. 10.1111/j.1464-5491.2007.02049.x [DOI] [PubMed] [Google Scholar]
  51. Korf E. S., White L. R., Scheltens P., Launer L. J. (2004). Midlife blood pressure and the risk of hippocampal atrophy: the Honolulu Asia Aging Study. Hypertension 44, 29–34. 10.1161/01.HYP.0000132475.32317.bb [DOI] [PubMed] [Google Scholar]
  52. Kuller L. H. (2003). Risk factors for dementia in the Cardiovascular Health Study cognition study. Rev. Neurol. 37, 122–126. [PubMed] [Google Scholar]
  53. Launer L. J., Ross G. W., Petrovitch H., Masaki K., Foley D., White L. R., et al. (2000). Midlife blood pressure and dementia: the Honolulu-Asia aging study. Neurobiol. Aging 21, 49–55 10.1016/S0197-4580(00)82899-7 [DOI] [PubMed] [Google Scholar]
  54. Lind J., Larsson A., Persson J., Ingvar M., Nilsson L. G., Bäckman L., et al. (2006). Reduced hippocampal volume in non-demented carriers of the apolipoprotein E epsilon4: relation to chronological age and recognition memory. Neurosci. Lett. 396, 23–27. 10.1016/j.neulet.2005.11.070 [DOI] [PubMed] [Google Scholar]
  55. Liu M., Zhang D., Shen D., Alzheimer’s Disease Neuroimaging Initiative . (2012). Ensemble sparse classification of Alzheimer’s disease. Neuroimage 60, 1106–1116. 10.1016/j.neuroimage.2012.01.055 [DOI] [PMC free article] [PubMed] [Google Scholar]
  56. Liu Y., Paajanen T., Westman E., Wahlund L. O., Simmons A., Tunnard C., et al. (2010). Effect of APOE epsilon4 allele on cortical thicknesses and volumes: the AddNeuroMed study. J. Alzheimers Dis. 21, 947–966. 10.3233/JAD-2010-100201 [DOI] [PubMed] [Google Scholar]
  57. Lo R. Y., Jagust W. J. (2012). Vascular burden and Alzheimer disease pathologic progression. Neurology 79, 1349–1355 10.1212/WNL.0b013e318266fc9a [DOI] [PMC free article] [PubMed] [Google Scholar]
  58. Lopez O. L., Kuller L. H., Mehta P. D., Becker J. T., Gach H. M., Sweet R. A., et al. (2008). Plasma amyloid levels and the risk of AD in normal subjects in the Cardiovascular Health Study. Neurology 70, 1664–1671. 10.1212/01.wnl.0000306696.82017.66 [DOI] [PMC free article] [PubMed] [Google Scholar]
  59. Lu P. H., Thompson P. M., Leow A., Lee G. J., Lee A., Yanovsky I., et al. (2011). Apolipoprotein E genotype is associated with temporal and hippocampal atrophy rates in healthy elderly adults: a tensor-based morphometry study. J. Alzheimers Dis. 23, 433–442. 10.3233/JAD-2010-101398 [DOI] [PMC free article] [PubMed] [Google Scholar]
  60. Magnin B., Mesrob L., Kinkingnéhun S., Pélégrini-Issac M., Colliot O., Sarazin M., et al. (2009). Support vector machine-based classification of Alzheimer’s disease from whole-brain anatomical MRI. Neuroradiology 51, 73–83. 10.1007/s00234-008-0463-x [DOI] [PubMed] [Google Scholar]
  61. Marchand W. R., Lee J. N., Suchy Y., Garn C., Johnson S., Wood N., et al. (2011). Age-related changes of the functional architecture of the cortico-basal ganglia circuitry during motor task execution. Neuroimage 55, 194–203. 10.1016/j.neuroimage.2010.12.030 [DOI] [PubMed] [Google Scholar]
  62. Massaro J. M., D’Agostino R. B., Sr., Sullivan L. M., Beiser A., DeCarli C., Au R., et al. (2004). Managing and analysing data from a largescale study on Framingham Offspring relating brain structure to cognitive function. Stat. Med. 23, 351–367. 10.1002/sim.1743 [DOI] [PubMed] [Google Scholar]
  63. Minoshima S., Giordani B., Berent S., Frey K. A., Foster N. L., Kuhl D. E. (1997). Metabolic reduction in the posterior cingulate cortex in very early Alzheimer’s disease. Ann. Neurol. 42, 85–94. 10.1002/ana.410420114 [DOI] [PubMed] [Google Scholar]
  64. Misra C., Fan Y., Davatzikos C. (2009). Baseline and longitudinal patterns of brain atrophy in MCI patients, and their use in prediction of short-term conversion to AD: results from ADNI. Neuroimage 44, 1415–1422. 10.1016/j.neuroimage.2008.10.031 [DOI] [PMC free article] [PubMed] [Google Scholar]
  65. Moran A., Jacobs D. R., Jr., Steinberger J., Steffen L. M., Pankow J. S., Hong C. P., et al. (2008). Changes in insulin resistance and cardiovascular risk during adolescence: establishment of differential risk in males and females. Circulation 117, 2361–2368. 10.1161/CIRCULATIONAHA.107.704569 [DOI] [PubMed] [Google Scholar]
  66. Mosconi L. (2005). Brain glucose metabolism in the early and specific diagnosis of Alzheimer’s disease. FDG-PET studies in MCI and AD. Eur. J. Nucl. Med. Mol. Imaging 32, 486–510. 10.1007/s00259-005-1762-7 [DOI] [PubMed] [Google Scholar]
  67. Mosconi L., Brys M., Glodzik-Sobanska L., De Santi S., Rusinek H., de Leon M. J. (2007). Early detection of Alzheimer’s disease using neuroimaging. Exp. Gerontol. 42, 129–138 10.1016/j.exger.2006.05.016 [DOI] [PubMed] [Google Scholar]
  68. Neufang S., Akhrif A., Riedl V., Förstl H., Kurz A., Zimmer C., et al. (2011). Disconnection of frontal and parietal areas contributes to impaired attention in very early Alzheimer’s disease. J. Alzheimers Dis. 25, 309–321. 10.3233/JAD-2011-102154 [DOI] [PubMed] [Google Scholar]
  69. Neufang S., Akhrif A., Riedl V., Förstl H., Kurz A., Zimmer C., et al. (2013). Predicting effective connectivity from resting-state networks in healthy elderly and patients with prodromal Alzheimer’s disease. Hum. Brain Mapp. 35, 954–963. 10.1002/hbm.22226 [DOI] [PMC free article] [PubMed] [Google Scholar]
  70. Obisesan T. O., Obisesan O. A., Martins S., Alamgir L., Bond V., Maxwell C., et al. (2008). High blood pressure, hypertension, and high pulse pressure are associated with poorer cognitive function in persons aged 60 and older: the Third National Health and Nutrition Examination Survey. J. Am. Geriatr. Soc. 56, 501–509. 10.1111/j.1532-5415.2007.01592.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  71. O’Dwyer L., Lamberton F., Matura S., Tanner C., Scheibe M., Miller J., et al. (2012). Reduced hippocampal volume in healthy young ApoE4 carriers: an MRI study. PLoS ONE 7:e48895. 10.1371/journal.pone.0048895 [DOI] [PMC free article] [PubMed] [Google Scholar]
  72. Perneczky R., Drzezga A., Diehl-Schmid J., Li Y., Kurz A. (2007). Gender differences in brain reserve: an (18)F-FDG PET study in Alzheimer’s disease. J. Neurol. 254, 1395–1400. 10.1007/s00415-007-0558-z [DOI] [PubMed] [Google Scholar]
  73. Plant C., Teipel S. J., Oswald A., Böhm C., Meindl T., Mourao-Miranda J., et al. (2010). Automated detection of brain atrophy patterns based on MRI for the prediction of Alzheimer’s disease. Neuroimage 50, 162–174. 10.1016/j.neuroimage.2009.11.046 [DOI] [PMC free article] [PubMed] [Google Scholar]
  74. Plavinskaia S. I., Shestov D. B. (1991). [The comparative characteristics of male and female mortality from the basic cardiovascular diseases based on the data of a prospective study]. Ter. Arkh. 63, 69–73. [PubMed] [Google Scholar]
  75. Purandare N. (2009). Preventing dementia: role of vascular risk factors and cerebral emboli. Br. Med. Bull. 91, 49–59. 10.1093/bmb/ldp020 [DOI] [PubMed] [Google Scholar]
  76. Rasgon N. L., Kenna H. A., Wroolie T. E., Kelley R., Silverman D., Brooks J., et al. (2011). Insulin resistance and hippocampal volume in women at risk for Alzheimer’s disease. Neurobiol. Aging 32, 1942–1948. 10.1016/j.neurobiolaging.2009.12.005 [DOI] [PMC free article] [PubMed] [Google Scholar]
  77. Razay G., Vreugdenhil A., Wilcock G. (2007). The metabolic syndrome and Alzheimer disease. Arch. Neurol. 64, 93–96 10.1001/archneur.64.1.93 [DOI] [PubMed] [Google Scholar]
  78. Reiman E. M. (2007). Linking brain imaging and genomics in the study of Alzheimer’s disease and aging. Ann. N. Y. Acad. Sci. 1097, 94–113. 10.1196/annals.1379.011 [DOI] [PubMed] [Google Scholar]
  79. Riello R., Sabattoli F., Beltramello A., Bonetti M., Bono G., Falini A., et al. (2005). Brain volumes in healthy adults aged 40 years and over: a voxel-based morphometry study. Aging Clin. Exp. Res. 17, 329–336. 10.1007/BF03324618 [DOI] [PubMed] [Google Scholar]
  80. Rizk-Jackson A., Stoffers D., Sheldon S., Kuperman J., Dale A., Goldstein J., et al. (2011). Evaluating imaging biomarkers for neurodegeneration in pre-symptomatic Huntington’s disease using machine learning techniques. Neuroimage 56, 788–796. 10.1016/j.neuroimage.2010.04.273 [DOI] [PubMed] [Google Scholar]
  81. Romero J. R., Beiser A., Seshadri S., Benjamin E. J., Polak J. F., Vasan R. S., et al. (2009). Carotid artery atherosclerosis, MRI indices of brain ischemia, aging, and cognitive impairment: the Framingham study. Stroke 40, 1590–1596. 10.1161/STROKEAHA.108.535245 [DOI] [PMC free article] [PubMed] [Google Scholar]
  82. Rouch I., Roche F., Dauphinot V., Laurent B., Antérion C. T., Celle S., et al. (2012). Diabetes, impaired fasting glucose, and cognitive decline in a population of elderly community residents. Aging Clin. Exp. Res. 24, 377–383. 10.1007/BF03325269 [DOI] [PubMed] [Google Scholar]
  83. Sato J. R., Thomaz C. E., Cardoso E. F., Fujita A., Martin M. G. M., Amaro E., Jr. (2008). Hyperplane navigation: a method to set individual scores in fMRI group datasets. Neuroimage 42, 1473–1480. 10.1016/j.neuroimage.2008.06.024 [DOI] [PubMed] [Google Scholar]
  84. Scarmeas N., Stern Y., Mayeux R., Manly J. J., Schupf N., Luchsinger J. A. (2009). Mediterranean diet and mild cognitive impairment. Arch. Neurol. 66, 216–225. 10.1001/archneurol.2008.536 [DOI] [PMC free article] [PubMed] [Google Scholar]
  85. Scazufca M., Menezes P. R., Vallada H. P., Crepaldi A. L., Pastor-Valero M., Coutinho L. M., et al. (2008). High prevalence of dementia among older adults from poor socioeconomic backgrounds in Sao Paulo, Brazil. Int. Psychogeriatr. 20, 394–405. 10.1017/S1041610207005625 [DOI] [PubMed] [Google Scholar]
  86. Scazufca M., Seabra C. A. (2008). Sao Paulo portraits: ageing in a large metropolis. Int. J. Epidemiol. 37, 721–723 10.1093/ije/dym154 [DOI] [PubMed] [Google Scholar]
  87. Seshadri S. (2006). Methodology for measuring cerebrovascular disease burden. Int. Rev. Psychiatry 18, 409–422. 10.1080/09540260600935413 [DOI] [PubMed] [Google Scholar]
  88. Seshadri S., Wolf P. A., Beiser A., Elias M. F., Au R., Kase C. S., et al. (2004). Stroke risk profile, brain volume, and cognitive function: the Framingham Offspring Study. Neurology 63, 1591–1599. 10.1212/01.WNL.0000142968.22691.70 [DOI] [PubMed] [Google Scholar]
  89. Smola A. J., Schölkopf B. (1998). On a kernel-based method for pattern recognition, regression, approximation and operator in version. Algorithmica 22, 211–231 10.1007/PL00013831 [DOI] [Google Scholar]
  90. Stuerenburg H. J., Ganzer S., Arlt S., Müller-Thomsen T. (2005). The influence of smoking on plasma folate and lipoproteins in Alzheimer disease, mild cognitive impairment and depression. Neuro Endocrinol. Lett. 26, 261–263. [PubMed] [Google Scholar]
  91. Takahashi R., Ishii K., Kakigi T., Yokoyama K. (2011). Gender and age differences in normal adult human brain: voxel-based morphometric study. Hum. Brain Mapp. 32, 1050–1058. 10.1002/hbm.21088 [DOI] [PMC free article] [PubMed] [Google Scholar]
  92. Tamashiro-Duran J. H., Squarzoni P., de Souza Duran F. L., Curiati P. K., Vallada H. P., Buchpiguel C. A., et al. (2013). Cardiovascular risk in cognitively preserved elderlies is associated with glucose hypometabolism in the posterior cingulate cortex and precuneus regardless of brain atrophy and apolipoprotein gene variations. Age (Dordr.) 35, 777–792. 10.1007/s11357-012-9413-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  93. Thomaz C. E., Kitani E. C., Gillies D. F. (2006). A Maximum Uncertainty LDA-based approach to classify and analyse MR brain images. Lect. Notes Comput. Sci. 3216, 291–300 10.1007/978-3-540-30135-6_36 [DOI] [Google Scholar]
  94. Vemuri P., Gunter J. L., Senjem M. L., Whitwell J. L., Kantarci K., Knopman D. S., et al. (2008). Alzheimer’s disease diagnosis in individual subjects using structural MR images: validation studies. Neuroimage 39, 1186–1197. 10.1016/j.neuroimage.2007.09.073 [DOI] [PMC free article] [PubMed] [Google Scholar]
  95. Viswanathan A., Rocca W. A., Tzourio C. (2009). Vascular risk factors and dementia: how to move forward? Neurology 72, 368–374. 10.1212/01.wnl.0000341271.90478.8e [DOI] [PMC free article] [PubMed] [Google Scholar]
  96. Watts A. S., Loskutova N., Burns J. M., Johnson D. K. (2013). Metabolic syndrome and cognitive decline in early Alzheimer’s disease and healthy older adults. J. Alzheimers Dis. 35, 253–265. 10.3233/JAD-121168 [DOI] [PMC free article] [PubMed] [Google Scholar]
  97. Westman E., Muehlboeck J. S., Simmons A. (2012). Combining MRI and CSF measures for classification of Alzheimer’s disease and prediction of mild cognitive impairment conversion. Neuroimage 62, 229–238. 10.1016/j.neuroimage.2012.04.056 [DOI] [PubMed] [Google Scholar]
  98. Wilson P. W., D’Agostino R. B., Levy D., Belanger A. M., Silbershatz H., Kannel W. B. (1998). Prediction of coronary heart disease using risk factor categories. Circulation 97, 1837–1847 10.1161/01.CIR.97.18.1837 [DOI] [PubMed] [Google Scholar]
  99. Xu W., Qiu C., Gatz M., Pedersen N. L., Johansson B., Fratiglioni L. (2009). Mid- and late-life diabetes in relation to the risk of dementia: a population-based twin study. Diabetes 58, 71–77. 10.2337/db08-0586 [DOI] [PMC free article] [PubMed] [Google Scholar]
  100. Yakushev I., Hammers A., Fellgiebel A., Schmidtmann I., Scheurich A., Buchholz H. G., et al. (2009). SPM-based count normalization provides excellent discrimination of mild Alzheimer’s disease and amnestic mild cognitive impairment from healthy aging. Neuroimage 44, 43–50. 10.1016/j.neuroimage.2008.07.015 [DOI] [PubMed] [Google Scholar]
  101. Yao X. Y., Lin Y., Geng J. L., Sun Y. M., Chen Y., Li Y. S. (2012). An analysis of risk factors for ischemic stroke of different age and gender. Zhonghua Nei Ke Za Zhi 51, 630–633. [PubMed] [Google Scholar]
  102. Yasuda M., Mori E., Kitagaki H., Yamashita H., Hirono N., Shimada K., et al. (1998). Apolipoprotein E epsilon 4 allele and whole brain atrophy in late-onset Alzheimer’s disease. Am. J. Psychiatry 155, 779–784. [DOI] [PubMed] [Google Scholar]
  103. Ystad M. A., Lundervold A. J., Wehling E., Espeseth T., Rootwelt H., Westlye L. T., et al. (2009). Hippocampal volumes are important predictors for memory function in elderly women. BMC Med. Imaging 9:17. 10.1186/1471-2342-9-17 [DOI] [PMC free article] [PubMed] [Google Scholar]
  104. Zhang D., Shen D. (2012). Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer’s disease. Neuroimage 59, 895–907. 10.1016/j.neuroimage.2011.09.069 [DOI] [PMC free article] [PubMed] [Google Scholar]
  105. Zipser B. D., Johanson C. E., Gonzalez L., Berzin T. M., Tavares R., Hulette C. M., et al. (2007). Microvascular injury and blood-brain barrier leakage in Alzheimer’s disease. Neurobiol. Aging 28, 977–986. 10.1016/j.neurobiolaging.2006.05.016 [DOI] [PubMed] [Google Scholar]
  106. Zivadinov R., Weinstock-Guttman B., Hashmi K., Abdelrahman N., Stosic M., Dwyer M., et al. (2009). Smoking is associated with increased lesion volumes and brain atrophy in multiple sclerosis. Neurology 73, 504–510. 10.1212/WNL.0b013e3181b2a706 [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Frontiers in Aging Neuroscience are provided here courtesy of Frontiers Media SA

RESOURCES