Skip to main content
PMC home page
Translational Psychiatry logoLink to Translational Psychiatry
. 2014 Jul 29;4(7):e419. doi: 10.1038/tp.2014.58

Cerebrospinal fluid markers including trefoil factor 3 are associated with neurodegeneration in amyloid-positive individuals

R W Paterson 1, J W Bartlett 2, K Blennow 3, N C Fox 1; Alzheimer's Disease Neuroimaging Initiative*,6, L M Shaw 4, J Q Trojanowski 4, H Zetterberg 3,5, J M Schott 1,*
PMCID: PMC4119225  PMID: 25072324

Abstract

We aimed to identify cerebrospinal fluid (CSF) biomarkers associated with neurodegeneration in individuals with and without CSF evidence of Alzheimer pathology. We investigated 287 Alzheimer's Disease Neuroimaging Initiative (ADNI) subjects (age=74.9±6.9; 22/48/30% with Alzheimer's disease/mild cognitive impairment/controls) with CSF multiplex analyte data and serial volumetric MRI. We calculated brain and hippocampal atrophy rates, ventricular expansion and Mini Mental State Examination decline. We used false discovery rate corrected regression analyses to assess associations between CSF variables and atrophy rates in individuals with and without amyloid pathology, adjusting in stages for tau, baseline volume, p-tau, age, sex, ApoE4 status and diagnosis. Analytes showing statistically significant independent relationships were entered into reverse stepwise analyses. Adjusting for tau, baseline volume, p-tau, age, sex and ApoE4, 4/83 analytes were significantly independently associated with brain atrophy rate, 1/83 with ventricular expansion and 2/83 with hippocampal atrophy. The strongest CSF predictor for the three atrophy measures was low trefoil factor 3 (TFF3). High cystatin C (CysC) was associated with higher whole brain atrophy and hippocampal atrophy rates. Lower levels of vascular endothelial growth factor and chromogranin A (CrA) were associated with higher whole brain atrophy. In exploratory reverse stepwise analyses, lower TFF3 was associated with higher rates of whole brain, hippocampal atrophy and ventricular expansion. Lower levels of CrA were associated with higher whole brain atrophy rate. The relationship between low TFF3 and increased hippocampal atrophy rate remained after adjustment for diagnosis. We identified a series of CSF markers that are independently associated with rate of neurodegeneration in amyloid-positive individuals. TFF3, a substrate for NOTCH processing may be an important biomarker of neurodegeneration across the Alzheimer spectrum.

Introduction

Although Alzheimer's disease (AD) is a relentless progressive condition there is considerable variation in the rate of progression between individuals.1 Previous studies have suggested that atrophy rates may be affected by the age of onset,2 disease severity,3 by the concurrence of other pathologies including vascular disease4 and TDP43 burden.5 However, the majority of the variance in rates of atrophy between individuals remains unaccounted for.6 A more detailed understanding of factors influencing this variability could allow for prognostication for patients, and aid in clinical trial design or interpretation where interindividual variance in atrophy rate increases required sample sizes;6 and provide insights into the underlying biology of AD, in turn leading to the discovery of new targets for disease prevention strategies. Biomarkers provide a means both of quantifying the rate of disease progression and exploring its influences. Rates of atrophy, either of brain or brain substructures can be measured with a high degree of precision from serially acquired MRI and provide a robust measure of progression which correlates with cognitive decline.7 Cerebrospinal fluid (CSF) can be used to assess neuronal, synaptic, inflammatory, and other proteins involved, or potentially involved, in AD pathogenesis.8 To date, Aβ1-42 and tau are routinely measured as AD biomarkers,8 with good evidence that these are markers of AD pathology and predict cognitive decline in mild cognitive impairment.9 What is less clear however is which CSF markers best reflect rates of neuronal damage or loss in AD—and therefore may be useful predictors of progression. A previous exploratory pilot study of CSF biomarkers in healthy elderly with amyloid pathology identified a number of analytes that may predict atrophy in specific brain regions.10 In this study we aimed to assess whether any analytes in a large panel of CSF biomarkers were associated with increased rates of atrophy across the Alzheimer spectrum.

Patients and Methods

Subjects

We investigated subjects from the Alzheimer's Disease Neuroimaging Initiative (ADNI) (adni.loni.ucla.edu), a multicenter publicly/privately funded longitudinal study of individuals with AD, amnestic mild cognitive impairment (MCI) and normal cognition. Institutional review boards approved the study and subjects gave written consent. Subjects underwent baseline and periodic clinical and neuropsychological assessment and serial MRI. Approximately 60% had CSF. A selected group had additional CSF analysis for the ADNI Biomarkers Consortium project ‘Use of Targeted Multiplex Proteomic Strategies to Identify Novel Cerebrospinal Fluid (CSF) Biomarkers in AD' as described on the ADNI website. We downloaded data from LONI (http://adni.loni.ucla.edu) that included all subjects with this supplementary CSF multiplex data. As our aim was to explore factors influencing atrophy rates in individuals with AD pathology we dichotomised subjects using a baseline CSF Aβ1-42 level of 192 pg ml−1, a level shown to distinguish individuals with autopsy confirmed AD pathology and controls with ~96% sensitivity and ~77% specificity.11 We excluded subjects who did not have useable 1.5T MRI scans at baseline and 1 year, and one subject without a defined diagnosis. We recorded ApoE status and genotype at the rs7280100 SNP, which has been identified a candidate locus for trefoil factor 3 (TFF3),12 as well as Mini Mental State Examination (MMSE) at baseline and 12 months.

Cerebrospinal fluid

CSF collection, processing and storage procedures have previously been described.11 Processing, aliquoting and storage was carried out according to the ADNI Biomarker Core Laboratory Standard Operating Procedures (http://adni-info.org/Scientists/Pdfs/adniproceduresmanual12.pdf). Samples were analyzed using a multiplex-based immunoassay panel based upon Luminex immunoassay technology developed by Rules Based Medicine (MyriadRBM, Austin, TX, USA). CSF Aβ1-42, total tau (t-tau) and phosphorylated tau (p-tau) and a panel of 159 analytes including inflammatory, metabolic, lipid and other disease relevant analytes were tested. Data were prepared for analysis according to the biomarkers consortium statistical analysis plan (http://adni.loni.ucla.edu/wp-content/uploads/2012/01/2011Dec28-Biomarkers-Consortium-Data-Primer-FINAL1.pdf), and as previously described.13 Of 159 analytes, 76 had greater than 10% of quality control data missing, leaving 83 available for analysis. For each analyte, the normality of data was assessed by the ADNI Biomarkers Consortium: non-normal data were transformed using the Box and Cox technique.14

Image acquisition

Details of the MRI methodology have previously been described.15 T1 weighted, inversion-recovery prepared structural images were acquired at baseline and 12 months on 1.5T MRI units using standardized protocols. Corrections for distortion due to gradient nonlinearity and for image intensity non-uniformity and scalings were made based on phantom measures. Images underwent central quality control evaluation for protocol compliance and internal quality control at the Dementia Research Centre.

Volume loss measurement

Image analysis was performed using in-house MIDAS software.16 Whole brain and lateral ventricles were delineated semi-automatically and hippocampal volumes were measured using the automated HMAPS method.17 Volume loss (ml) between scans was obtained using the boundary shift integral (BSI) following a 9-degrees-of-freedom registration and differential bias correction of the follow-up to baseline scans. For lateral ventricles and hippocampi, change over time was quantified using the ventricular (VBSI)18 and hippocampal BSI (HBSI)17 respectively. Rates of volume loss were annualized using the interscan interval.

Statistical analysis

To assess the relationship between CSF analytes and rates of brain volume change, we fitted separate regression models for rates of ventricular expansion, brain and hippocampal atrophy for each CSF variable, including baseline volume (brain, ventricular and hippocampal volume, respectively) and tau as covariates in both the amyloid positive and negative groups. Subsequent analyses in the amyloid-positive group alone were repeated including age, gender, APOE4 status and phospho-tau (p-tau) as additional covariates and finally also adjusting for baseline diagnosis (AD, MCI, control). We used an implementation of the false discovery rate (FDR) procedure19 with control at the 5% level to correct for multiple comparisons, and report the adjusted regression coefficients between each atrophy rate and those CSF variables showing FDR significant relationships. We then performed three exploratory reverse stepwise regression analyses to identify combinations of CSF analytes independently predicting increased rates of change for each measure, using FDR significant CSF variables identified in the preceding step and the three sets of adjustment variables. In each stepwise analysis, the corresponding adjustment variables were forced to be included in regression models. Finally, we assessed whether CSF analytes were associated with cognitive function. We first established whether there was a decline in MMSE between baseline and 12 months that was significantly different from zero. We then determined if atrophy rates and decline in MMSE scores at 12 months were correlated using separate regression models for rates of ventricular expansion, brain and hippocampal atrophy. We then fitted separate regression models for annualized change in MMSE score and each CSF variable found to be (after FDR control) associated with at least one atrophy measure.

The FDR procedure used was derived assuming independence between test statistics.19 However, it has been shown that the procedure is valid under certain types of dependence,20 and in a simulation study (results not shown) matching the analysis used here, the procedure correctly controlled the FDR at 5%.

To quantify the unadjusted group discrimination ability of the analytes that were FDR significant adjusted for baseline brain volumes, sex, age, APOE4 status, tau and p-tau the area under the ROC curve for detecting between AD and control groups was estimated.

Results

Baseline group characteristics

A flow chart outlining subject inclusion is provided in Figure 1

Figure 1.

Figure 1

Open in a new tab

Subjects included in analysis. ADNI, Alzheimer's Disease Neuroimaging Initiative; CSF, cerebrospinal fluid.

The demographics, genetic characteristics, cognitive scores and atrophy measures of the 287 subjects included in this analysis are described in Table 1. The mean±s.d. age of this group was 74.9±6.9 years, 21.6% had a clinical diagnosis of AD, 48.1% MCI and 30.3% were controls. Eighty-three CSF analytes as well as CSF tau, Aβ1-42 and p-tau were available for analysis (Supplementary Table 1).

Table 1. Baseline demographics, ApoE genotype, cognitive profiles, CSF profiles, brain volumes and 1 year atrophy rates of 200 subjects with Aβ1-42≤192 pg ml−1 and 87 subjects with Aβ1-42>192 pg ml−1.

  Subjects with Aβ1-42 ≤192 pg ml−1 (n=200)
  Combined Controls (n=33) MCI (n=108) AD (n=59)
Age at CSF exam (years) 74.8±6.7 76.5±5.5 74.4±7.0 74.5±7.4
Gender (% male) 59.4 54.5 63.9 52.5
APOE4 positive (%) 65.5 51.5 69.0 78.0
MMSE (mean) 26.1±2.5 29.1±0.1 26.7±1.8 23.5±1.8
Modified ADAS-cog 13.1±6.2 7.1±3.4 12.1±4.6 18.5±6.1
Aβ1-42 (pg ml−1) 137.2±22.7 146.5±25.5 136.5±29.0 133.1±23.2
t-tau (pg ml−1) 114.4±55.3 82.5±30.7 115.3±56.0 130.7±57.7
p-tau (pg ml−1) 39.5±17.5 31.2±17.4 39.8 ±15.4 43.6±19.8
KBSI (ml per year) 13.8±8.7 8.9±7.3 14.2±9 15.7±7.8
VBSI (ml per year) 3.8±3.1 2.1±2.0 3.8±3.1 4.9±3.1
HBSI (ml per year) 0.15±0.10 0.08±0.1 0.1±0.1 0.2±0.1
MMSE decline from baseline to 12 months (points per year; n=199) 1.7±3.5 0.4±1.7 1.4±2.7 3.0±4.8
% of individuals with minor allele rs7280100 12.2 12.5 10.9 14.6
  Subjects with Aβ1-42>192 pg ml−1 (n=87)
  Combined Controls (n=54) MCI (n=30) AD (n=3)
Age at CSF exam (years) 75.4±6.3 74.9±5.2 75.5±8.0 81.4±6
Gender (% male) 62.1 50 80 100
APOE4 positive (%) 89.6 90.7 86.7 100.0
MMSE (mean) 28.3±1.7 29.0±1.0 27.2±1.9 25.3±1.2
Modified ADAS-cog 7.6±1.4 5.7±2.5 10.5±3.8 14.4±6.8
Aβ1-42 (pg ml−1) 244.4±26.1 243.1±25.6 246.5±26.0 247.0±45.7
t-tau (pg ml−1) 62.2±20.9 60.8±21.4 64.3±20.2 66±22.3
p-tau (pg ml−1) 21.0±8.0 20.6±7.9 21.8±8.5 21.3±7.5
KBSI (ml per year) 6.0±6.7 4.7±5.4 7.5±8.0 12.6±10.5
VBSI (ml per year) 1.4±1.6 1.1±1.1 1.7±2.1 2.5±2.5
HBSI (ml per year) 0.05±0.1 0.03±0.09 0.07±0.1 0.1±0.06
MMSE decline from baseline to 12 months (points per year; n=199) 0.1±1.6 0.06±1.3 0.2±2 0±2
% of individuals with minor allele rs7280100 12.0 13.2 11.1 0
Open in a new tab

Abbreviations: AD, Alzheimer's disease; ADAS-cog, Alzheimer's Disease Assessment Scale-cognitive subscale; CSF, cerebrospinal fluid; HBSI, hippocampal boundary shift integral; KBSI, whole brain boundary shift integral; MCI, mild cognitive impairment; MMSE, mini mental state examination; p-tau, phosphorylated tau; t-tau, total tau; VBSI, ventricular boundary shift integral. Mean±s.d. provided unless stated.

Analytes predicting atrophy

In subjects without evidence for significant amyloid deposition, that is, those with baseline CSF Aβ1-42 >192 pg ml−1, after adjusting for baseline brain volumes and CSF t-tau and with FDR correction to control for multiple comparisons, none of the CSF analytes was significantly associated with any of the atrophy measures.

In subjects with CSF Aβ1-42 ⩽192 pg ml−1, after adjusting for baseline volumes and t-tau and with FDR correction to control for multiple comparisons, 10/83 analytes were associated with whole brain atrophy rate, 45/83 analytes with ventricular expansion rate, and 4/83 with hippocampal atrophy rate (Table 2). After additionally adjusting for p-tau, age, ApoE status and sex and with FDR correction to control for multiple comparisons, 4/83 analytes were associated with whole brain atrophy rate, 1/83 analyte with ventricular expansion rate, and 2/83 with hippocampal atrophy rate (Table 2). These relationships are illustrated using scatter plots in Figure 2. After additionally adjusting for baseline diagnosis, only 2/83 analytes were associated with hippocampal atrophy, and none with brain atrophy or ventricular expansion (Table 2).

Table 2. Regression coefficients for dependence of atrophy measures on CSF with control for the false discovery rate in subjects with low CSF Aβ1-42 (⩽192 pg ml−1): adjusted for baseline brain volumes and tau; adjusted for baseline brain volumes, sex, age, APOE4 status, t-tau and p-tau; adjusted for baseline brain volumes, sex, age, APOE4 status, t-tau, p-tau and baseline diagnosis.

  Brain atrophy
 Ventricular expansion
 Hippocampal atrophy
  Regression coefficient P Regression coefficient P Regression coefficient P
Adjusting for baseline brain volumes and t-tau
 Alpha-1-Microglobulina (μg ml−1)     −3.17 0.002    
 Alpha-2-Macroglobulina (mg ml−1)     −4.31 0.006    
 Alpha-1-Antitrypsina (mg ml−1)     −0.19 0.018    
 Angiotensin-converting enzymea (ng ml−1)     −3.17 0.027    
 Angiopoietin-2a (ng ml−1)     −3.24 0.013    
 Apolipoprotein A-Ia (mg ml−1)     −2.39 0.018    
 Apolipoprotein C-IIIa(μg ml−1)     −2.02 0.042    
 Apolipoprotein Da (μg ml−1)     −3.54 0.003    
 Apolipoprotein Ea (μg ml−1) −14.71 0.017 −0.26 0.002    
 Apolipoprotein Ha (μg ml−1)     −2.99 0.004    
 AXL receptor tyrosine kinase (ng ml−1) −1.59 0.01 −0.40 0.018    
 Beta-2-Microglobulina (μg ml−1)     −3.87 0.018    
 Complement C3a (mg ml−1)     −3.80 0.003    
 CD-40 antigena (ng ml−1)     −5.20 0.004    
 Chromogranin-A (ng ml−1) −0.05 0.008 −0.013 0.009    
 Clusterina (μg ml−1) −11.90 0.023 −4.20 0.002    
 Cystatin-Ca (ng ml−1)  32.89 0.003  10.77 <0.001  0.34 0.019
 Fibroblast growth factor 4a (pg ml−1)      3.45 0.022    
 Fibrinogena (mg ml−1)     −0.28 0.001    
 Heparin-binding EGF-like growth factora (pg ml−1)     −4.08 0.048    
 Hepatocyte growth factora (ng ml−1)     −2.59 0.048    
 Immunoglobulin Aa (mg ml−1)     −1.28 0.048    
 Interleukin-3a (ng ml−1) −5.66 0.036 −2.02 0.003    
 Insulin-like growth factor-binding protein (ng ml−1)     −0.017 0.004    
 Interferon gamma induced Protein 10a (pg ml−1)     −0.17 0.034    
 Lectin-like oxidized LDL receptor 1 (ng ml−1)     −0.30 0.006    
 Macrophage colony-stimulating factor 1a (ng ml−1) −15.02 0.023 −5.89 <0.001    
 Monokine induced by gamma interferona (pg ml−1)     −1.66 0.009    
 Neutrophil gelatinase-associated lipocalina (ng ml−1)     −2.49 0.018    
 N-terminal prohormone of brain natriuretic peptidea (pg ml−1)     −3.91 0.006  −0.15 0.035
 Placenta growth factora (pg ml−1)     −2.34 0.043    
 Pancreatic polypeptidea (pg ml−1)     −1.31 0.038    
 Serum amyloid P-componenta (μg ml−1)     −1.56 0.03    
 Stem cell factora (pg ml−1)     −0.18 0.027    
 Sex hormone-binding globulina (nmol/l)     −2.23 0.018    
 Thyroxine-binding globulina (μg ml−1)     −0.18 0.023    
 Tissue factora (μg ml−1) −11.79 0.017 −3.73 0.003    
 Trefoil factor 3a (μg ml−1) −14.69 0.003 −6.19 <0.001  −0.178 0.002
 Tissue inhibitor of metalloproteinases 1a (ng ml−1)     −3.88 0.015    
 Thrombomodulina (ng ml−1)     −2.52 0.045    
 Tumor necrosis factor receptor 2a (ng ml−1)     −4.05 0.007    
 TNF-related apoptosis-inducing ligand receptor 3a (ng ml−1)     −4.05 0.004    
 Vascular cell adhesion molecule-1a (ng ml−1)      3.46 0.018    
 Vascular endothelial growth factora (pg ml−1) −21.32 0.004 −6.86 <0.001  −0.21 0.034
 von Willebrand factora (μg ml−1)     −4.18 0.003    
             
Adjusting for baseline brain volumes, sex, age, APOE4 status, tau and p-tau
 Chromogranin-A (ng ml−1) −0.05 0.009        
 Cystatin-Ca (ng ml−1)  32.58 0.009      0.35 0.034
 Trefoil factor 3a (μg ml−1) −16.43 0.009 −4.46 0.03  −0.23 0.001
 Vascular endothelial growth factora (pg ml−1) −20.09 0.023        
             
Adjusting for baseline brain volumes, sex, age, APOE4 status, tau, p-tau and baseline diagnosis
 Trefoil factor 3a (μg ml−1)          −0.21 0.007
 N-terminal prohormone of brain natriuretic peptidea (pg ml−1)          −0.16 0.05
Open in a new tab

Abbreviations: CSF, cerebrospinal fluid; EGF, endothelial growth factor; FDR, false discovery rate; p-tau, phosphorylated tau; t-tau, total tau.

a

Transformed data. The statistics are presented for the transformed values (see Patients and Methods). Where data has been transformed, the units relate to data before transformation. None of the analytes in Supplementary Table 1 was FDR significant except those shown in this table.

Regression coefficients are shown for those measures showing FDR significant (5% level) associations.

P-values are FDR (5% level) corrected.

Figure 2.

Figure 2

Open in a new tab

Scatter plots of annualized atrophy (BSI—whole brain atrophy, HBSI—hippocampal atrophy, VSBI—ventricular expansion) against analytes for those found to be associated (after FDR correction) with rates of volume change after adjusting for baseline volume, sex, age, APOE4 status, t-tau and p-tau. *, transformed data. Where data has been transformed (TFF3, CysC, VEGF), the units relate to data before transformation. AD, Alzheimer's disease; CSF, cerebrospinal fluid; BSI, boundary shift integral; FDR, false discovery rate; MCI, mild cognitive impairment; p-tau, phosphorylated tau; t-tau, total tau; TFF3, trefoil factor 3.

Lower levels of TFF3 were consistently associated with greater ventricular expansion (P<0.001), hippocampal atrophy rate (P<0.001) and whole brain atrophy rate (P<0.001) even after adjusting for baseline brain volumes, t-tau, p-tau, age, APOE status and sex. After additionally adjusting for baseline diagnosis, lower levels of TFF3 were still associated with higher hippocampal atrophy (P=0.007). Higher levels of Cystatin C (CysC) were positively associated with all three atrophy measures after adjusting for baseline brain volumes and t-tau and remained predictive of higher whole brain (P=0.009) and hippocampal atrophy (P=0.034) after adjusting for p-tau, age, ApoE status and sex. Lower levels of vascular endothelial growth factor (VEGF) were positively associated with all three atrophy measures after adjusting for baseline brain volumes and t-tau and remained associated with higher whole brain atrophy (P=0.023) after adjusting for p-tau, age, APOE status and sex. Lower levels of Chromogranin-A (CgA) were associated with higher whole brain atrophy (0.008) and ventricular expansion (0.009) after adjusting for baseline volumes and t-tau and predicts higher whole brain atrophy (P=0.009) after additionally adjusting for p-tau, age, ApoE status and sex.

In exploratory reverse stepwise models that included only those variables showing FDR significant associations in the initial analyses (Table 3), lower levels of TFF3 were associated with higher rates of whole brain atrophy, ventricular expansion and hippocampal atrophy, even when, p-tau, age, APOE status and sex were included in the model. Lower levels of CgA were associated with higher whole brain atrophy and ventricular expansion when t-tau and baseline volume were included in the model; and with higher whole brain atrophy when p-tau, age, APOE status and sex were also included as covariates. In addition, adjusting for baseline diagnosis, TFF3 was the only analyte independently associated with hippocampal atrophy rate; and no analytes were (independently) associated with whole brain atrophy or ventricular expansion.

Table 3. Exploratory reverse stepwise regression analysis of CSF analytes with an FDR significant association with brain atrophy measurement in subjects with low CSF Aβ1-42 (⩽192 pg ml−1): when adjusted for t-tau and baseline volume; when adjusted for baseline volume, sex, age, APOE4 status, t-tau and p-tau; when adjusted for baseline volume, sex, age, APOE4 status, t-tau and p-tau and baseline diagnosis.

Brain atrophy
 Ventricular expansion
 Hippocampal atrophy
Analyte Adjusted regression coefficient P Analyte Adjusted regression coefficient P Analyte Adjusted regression coefficient P
Adjusted for t-tau and baseline volume
 TFF3a (μg ml−1)  −12.3 0.001 TFF3a (μg ml−1) −4.7 <0.001 TFF3a (μg ml−1) −0.18 <0.001
 Chromogranin-A (ng ml−1)  −0.04 0.006 Fibrinogena (mg ml−1) −1.4 0.002      
      Angiotensin-converting enzymea (ng ml−1)  4.3 0.012      
      Macrophage colony-stimulating factor 1a (ng ml−1) −4.2 0.030      
      Chromogranin-A (ng ml−1) −0.01 0.032      
                 
Adjusted for baseline volume, sex, age, APOE4 status, t-tau and p-tau
 TFF3a (μg ml−1)  −13.2 0.004 TFF3a (μg ml−1) −4.5 <0.001 TFF3a (μg ml−1) −0.23 <0.001
 Chromogranin-A (ng ml−1)  −0.04 0.004            
                 
Adjusted for baseline volume, sex, age, APOE4 status, t-tau and p-tau and baseline diagnosis
            TFF3a (μg ml−1) −0.23 <0.001
Open in a new tab

Abbreviations: CSF, cerebrospinal fluid; FDR, false discovery rate; p-tau, phosphorylated tau; t-tau, total tau; TFF3, trefoil factor 3.

a

Transformed data. The statistics are presented for the transformed values (see Patients and Methods). Where data has been transformed the units relate to data before transformation.

P-values shown here do not account for multiple comparisons.

Twenty-three of the subjects had a minor allele at the rs7280100 locus (predicted to reduce CSF TFF3). These individuals had 18% higher rates of ventricular expansion, 14% higher rates of brain atrophy and 30% higher rates of hippocampal atrophy compared with noncarriers, the latter reaching borderline significance after adjustment for baseline diagnosis, (P=0.07).

Analytes predicting cognitive decline

In subjects with CSF Aβ1-42 >192 pg ml−1, MMSE data at 12 months was available for all 87 subjects. The average decline was not statistically significantly different from zero and therefore no further regression analyses were conducted in this group.

In subjects with CSF Aβ1-42 ≤192 pg ml−1, MMSE data at 0 and 12 months was available for 199 subjects, who declined on average by 1.7±3.5 points per year. Change in MMSE score at 12 months was strongly associated with change in whole brain atrophy rate (regression coefficient=−0.15, P<0.001), ventricular expansion (−0.49, P<0.001), and hippocampal atrophy rate. (−11.16, P<0.001) Baseline levels of 11 CSF markers—AXL, ApoE, CD-40 antigen, CgA, cystatin C, M-CSF, matrix metalloproteinase-2 (MMP-2), pregnancy-associated plasma protein, tissue factor, TFF3 and VEGF—were significantly (without FDR correction) associated with decline in MMSE at 12 months.

Predictive value

For those analytes that were FDR significant in Table 2, the area under the ROC curve for detecting between AD and control groups were 0.59 (95% confidence interval=0.50, 0.69; CgA), 0.55 (0.45, 0.64; CysC), 0.55 (0.45, 0.65; TFF3) and 0.61 (0.52, 0.70; VEGF). For reference, the corresponding estimated values for t-tau and p-tau were 0.85 and 0.83, respectively.

Discussion

Current models of AD pathogenesis suggest that deposition of brain Aβ is a very early feature of AD, probably occurring before the onset of AD-related neuronal loss (that is, neurodegeneration).21 Rates of atrophy are significantly increased in individuals with established AD,22 mild cognitive impairment due to AD,23 and in asymptomatic brain amyloidosis,24 and correlate more closely with cognitive decline and disease progression than amyloid burden or rate of accumulation.25 In this study, using a panel of analytes selected on the basis of relevance to a range of different diseases including cancer and autoimmune disorders as well as AD, we have identified a number of CSF biomarkers associated with increased rates of neurodegeneration. In particular, our results suggest that in individuals with evidence for brain amyloid deposition, CSF TFF3 level is associated both with rate of cognitive decline and with rates of brain and hippocampal atrophy and ventricular expansion.

Whilst we failed to find an association between any analyte and rate of atrophy in the amyloid negative group, after allowance for multiple comparisons in the amyloid-positive group in which we adjusted for baseline brain volume and t-tau, we found that 45 analytes predicted increased ventricular expansion and ten predicted rate of whole brain atrophy. Ventricular expansion and brain atrophy are closely correlated,26 and as expected, all ten factors predicting increased rates of whole brain atrophy also predicted increased ventricular expansion. The higher precision with which rate of ventricular change can be quantified18 is likely to explain the larger number of analytes associated with ventricular expansion compared with whole brain loss.

When we additionally adjusted for p-tau, ApoE status and sex, adjusting for multiple comparisons, the number of factors associated with rates of neurodegeneration in the amyloid-positive group alone was considerably reduced, with only four analytes showing an association with rates of neurodegeneration. Lower levels of TFF3, VEGF and CrA and higher levels of CysC were associated with increased rates of brain atrophy; lower levels of TFF3 with increased ventricular expansion; and lower levels of TFF3 and higher levels of CysC with increased rates of hippocampal atrophy. In exploratory reverse stepwise analyses, TFF3 was significantly associated with rate of decline in all three measures (Table 3), with an effect both independent from and at least as great as CSF t-tau, which as expected, also (unadjusted) predicted all three measures of neurodegeneration.27 The effect of TFF3 persisted even once baseline p-tau, age, sex and APOE4 status had been accounted for (Table 3), and was still associated with rate of hippocampal atrophy even once clinical diagnosis (for example, control/MCI/AD) had been accounted for. These results therefore support an association between CSF TFF3 and increased rates of neurodegeneration independent of established CSF biomarkers in individuals with amyloid deposition, suggesting that CSF TFF3 may be a novel and valuable biomarker of decline across the spectrum of AD.

Trefoil Factor 3 (TFF3)

Encoded by the TFF3 gene on chromosome 21, TFF3 is a protein expressed by secretory epithelial cells principally in the gastrointestinal tract, and also in human hypothalamus and pituitary,28 and in the hippocampi, temporal cortices and cerebellum of mice.29 Its function in the central nervous system is unknown,29 although TFF3 administration to mice has been reported to improve memory.30 In the periphery, TFF3 has important roles in NOTCH processing, and measurement of TFF3 in blood/urine/faeces has been patented31 and used32 as a means of assessing NOTCH-related side-effects in trials of gamma-secretase inhibitors for the treatment of AD. To our knowledge, this is the first study to implicate TFF3 as a marker for neurodegeneration across the AD spectrum, and furthermore to show that this is independent of t-tau and p-tau: while there are few data on which to suggest mechanisms, one intriguing possibility is that this effect might in some way be mediated by alterations in gamma-secretase processing. While numbers with a minor allele were too small for anything more than an exploratory analysis, the observation that genotype at the rs7280100, a candidate locus associated with TFF3, is intriguing, and if replicated in independent samples, suggests that CSF TFF3 and/or the rs7280100 genotype may both help predict the rate of neurodegeneration in individuals with amyloid pathology; and that elucidating the function of TFF3 in the central nervous system may provide insights into mechanisms influencing neurodegeneration in the presence of brain amyloidosis.

Cystatin C (CysC), Vascular Endothelial Growth Factor (VEGF) and Chromogranin-A (CgA)

Of the other three biomarkers emerging prominently from our analyses, CysC colocalizes with β amyloid in amyloid plaques, amyloid-laden vascular walls in cerebral amyloid angiopathy and in Down's syndrome and is typically reduced in AD CSF, with multiple lines of evidence suggesting that it has protective roles in AD principally due to influences on amyloid processing and deposition.33 Conversely, increased CysC immunoreactivity is seen in specific neuronal population in AD suggesting a role in neurodegeneration;33 and in dopaminergic neurons, CysC has been shown to have a role in neuronal injury-mediated microglial activation and neurotoxicity.34 Our finding of a positive relationship between rates of atrophy and CysC, in individuals in whom amyloid deposition has already occurred, could therefore be explained in terms of a harmful neuroinflammatory response which results in neuronal damage. VEGF, abundantly expressed in the CNS, has roles in modulation of angiogenesis, vascular remodelling, repair, permeability and inflammation,35 and is involved in microglial chemotaxis perhaps reflecting an early response to amyloid deposition.36 Our finding of increased atrophy with lower levels of CSF VEGF is consistent with VEGF having a protective role in AD, and in keeping with reports that transgenic AD mice with increased neuronal expression of VEGF have a functional improvement in memory,35 suggests that upregulation of VEGF may be a useful therapeutic strategy for AD. Increased levels of CSF VEGF has been seen in individuals with AD and vascular dementia compared with controls37—this could also represent a protective response although VEGF levels were not correlated with rate of atrophy or rate of cognitive decline., The neuroendocrine secretory protein CgA is the major protein of large dense-core synaptic vesicles and may be a marker of synaptic dysfunction.38 In one study lower CSF levels of CgA were reported in the CSF of subjects with early onset sporadic or familial Alzheimer's disease,39 potentially in keeping with our finding of inverse relationship between CgA level and increased rates of brain atrophy and ventricular expansion.

In a previous study using this same panel of analytes, ten CSF measures (ACE, CgA, AXL, TNF-related apoptosis-inducing ligand receptor, CD-40, M-CSF, beta-2-microglobulin, stem cell factor, CLU and IL-3) were shown to predict increased rates of amyloid deposition in cognitively normal elderly individuals.13 When comparing these results aiming at identifying markers predicting rate of amyloid accumulation in healthy controls with ours (assessing rate of neurodegeneration in individuals with likely amyloid pathology) it is notable that in our initial analysis, we identified five CSF analytes common to both: AXL, CgA, CLU, IL-3 and M-CSF; and including more stringent covariates that CgA remained a consistent finding. While this could reflect that rates of amyloid deposition and brain atrophy are highly correlated—as would be predicted in the mid-phase of AD pathogenesis—this would also be consistent with common mechanisms linking amyloid deposition to subsequent neurodegeneration. However, the fact that TFF3, CysC and VEGF were not identified in previous analyses may suggest that these analytes may be exerting their effects on neurodegeneration independent of amyloid deposition.

This study has a number of limitations. The number of subjects is relatively small, particularly relative to the number of analytes, and these findings thus require replication in other, larger cohorts. However, we have used a statistical procedure to control for multiple comparisons, indicating that the evidence for associations is moderately strong. While the use of reverse stepwise analysis must be considered exploratory, the consistency with which TFF3 emerges as a strong independent predictor of atrophy is striking. However, it is perhaps less surprising that the same analytes often predict all three atrophy measures, given that the atrophy measures are mutually correlated. A relatively small percentage of the variance in atrophy rates is explained by these findings suggesting that other factors and other biomarkers reflecting other independent pathways have yet to be identified, noting that a certain proportion of variance may also be due to measurement error. Including all individuals with low Aβ1-42 in our analysis assumes that all patients with brain amyloidosis are on the same neuropathological spectrum. While larger, more homogeneous samples are required to assess whether the relationships we show are driven by individuals with asymptomatic amyloidosis, MCI or established AD, it is notable that the relationship between TFF3 and hippocampal atrophy remains even after adjusting for clinical diagnosis—which in this study probably simply reflects different stages of disease.

We have identified a number of CSF markers that may be associated with the rate of neurodegeneration in individuals with amyloid deposition. These candidate biomarkers warrant further investigation, potentially providing prognostic information for patients; covariates for clinical trials; and insights into AD biology. While several of the CSF biomarkers hint at immune-mediated links between responses to amyloid deposition and brain volume loss, the function of TFF3, which we found to be the single strongest predictor of neurodegeneration across the spectrum of brain amyloidosis, is unknown. Further studies to replicate these findings and in particular to investigate the role of TFF3 in the pathogenesis of AD are required.

Acknowledgments

We gratefully acknowledge the support of Iceland Foods, the Leonard Wolfson Experimental Neurology Centre and Alzheimer's Research UK. This work was supported by the NIHR Queen Square Dementia BRU. We are very grateful to the reviewers for their thoughtful suggestions. Data collection and sharing for this project was funded by the Alzheimer's Disease Neuroimaging Initiative (ADNI; National Institutes of Health Grant U01 AG024904). ADNI is funded by the National Institute on Aging, the National Institute of Biomedical Imaging and Bioengineering and through generous contributions from the following: Alzheimer's Association; Alzheimer's Drug Discovery Foundation; BioClinica; Biogen Idec; Bristol-Myers Squibb Company; Eisai; Elan Pharmaceuticals; Eli Lilly and Company; F. Hoffmann-La Roche and its affiliated company Genentech; GE Healthcare; Innogenetics, N.V.; IXICO; Janssen Alzheimer Immunotherapy Research & Development, LLC; Johnson & Johnson Pharmaceutical Research & Development, LLC; Medpace; Merck; Meso Scale Diagnostics, LLC; NeuroRx Research; Novartis Pharmaceuticals Corporation; Pfizer; Piramal Imaging; Servier; Synarc; and Takeda Pharmaceutical Company. The Canadian Institutes of Health Research is providing funds to support ADNI clinical sites in Canada. Private sector contributions are facilitated by the Foundation for the National Institutes of Health (www.fnih.org). The grantee organization is the Northern California Institute for Research and Education, and the study is coordinated by the Alzheimer's Disease Cooperative Study at the University of California, San Diego, CA, USA. ADNI data are disseminated by the Laboratory for Neuro Imaging at the University of California, Los Angeles, CA, USA. This research was also supported by NIH grants P30 AG010129 and K01 AG030514.

The authors declare no conflict of interest.

Footnotes

Supplementary Information accompanies the paper on the Translational Psychiatry website (http://www.nature.com/tp)

Supplementary Material

Supplementary Table 1
Click here for additional data file. (166.5KB, doc)

References

  1. Schott JM, Frost C, Whitwell JL, Macmanus DG, Boyes RG, Rossor MN, et al. Combining short interval MRI in Alzheimer's disease: implications for therapeutic trials. J Neurol. 2006;253:1147–1153. doi: 10.1007/s00415-006-0173-4. [DOI] [PubMed] [Google Scholar]
  2. Woo JI, Kim JH, Lee JH. Age of onset and brain atrophy in Alzheimer's disease. Int Psychogeriatr. 1997;9:183–196. doi: 10.1017/s104161029700433x. [DOI] [PubMed] [Google Scholar]
  3. Chan D, Janssen JC, Whitwell JL, Watt HC, Jenkins R, Frost C, et al. Change in rates of cerebral atrophy over time in early-onset Alzheimer's disease: longitudinal MRI study. Lancet. 2003;362:1121–1122. doi: 10.1016/S0140-6736(03)14469-8. [DOI] [PubMed] [Google Scholar]
  4. Barnes J, Carmichael OT, Leung KK, Schwarz C, Ridgway GR, Bartlett JW, et al. Vascular and Alzheimer's disease markers independently predict brain atrophy rate in Alzheimer's Disease Neuroimaging Initiative controls. Neurobiol Aging. 2013;34:1996–2002. doi: 10.1016/j.neurobiolaging.2013.02.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Josephs KA, Whitwell JL, Knopman DS, Hu WT, Stroh DA, Baker M, et al. Abnormal TDP-43 immunoreactivity in AD modifies clinicopathologic and radiologic phenotype. Neurology. 2008;70:1850–1857. doi: 10.1212/01.wnl.0000304041.09418.b1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Schott JM, Bartlett JW, Barnes J, Leung KK, Ourselin S, Fox NC. Reduced sample sizes for atrophy outcomes in Alzheimer's disease trials: baseline adjustment. Neurobiol Aging. 2010;31:1452–1462. doi: 10.1016/j.neurobiolaging.2010.04.011. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Fox NC, Scahill RI, Crum WR, Rossor MN. Correlation between rates of brain atrophy and cognitive decline in AD. Neurology. 1999;52:1687–1689. doi: 10.1212/wnl.52.8.1687. [DOI] [PubMed] [Google Scholar]
  8. Blennow K, Hampel H, Weiner M, Zetterberg H. Cerebrospinal fluid and plasma biomarkers in Alzheimer disease. Nat Rev Neurol. 2010;6:131–144. doi: 10.1038/nrneurol.2010.4. [DOI] [PubMed] [Google Scholar]
  9. Hansson O, Zetterberg H, Buchhave P, Londos E, Blennow K, Minthon L. Association between CSF biomarkers and incipient Alzheimer's disease in patients with mild cognitive impairment: a follow-up study. Lancet Neurol. 2006;5:228–234. doi: 10.1016/S1474-4422(06)70355-6. [DOI] [PubMed] [Google Scholar]
  10. Mattsson N, Insel P, Nosheny R, Trojanowski JQ, Shaw LM, Jack CR, Jr, et al. Effects of cerebrospinal fluid proteins on brain atrophy rates in cognitively healthy older adults. Neurobiol Aging. 2014;35:614–622. doi: 10.1016/j.neurobiolaging.2013.08.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Shaw LM, Vanderstichele H, Knapik-Czajka M, Clark CM, Aisen PS, Petersen RC, et al. Cerebrospinal fluid biomarker signature in Alzheimer's disease neuroimaging initiative subjects. Ann Neurol. 2009;65:403–413. doi: 10.1002/ana.21610. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Kauwe J, Bailey M, Ridge P, Cruchaga C, Foutz S, Perry R, et al. Association of genetic variants with cerebrospinal fluid protein levels of ACE, MMP3 and other proteins and risk for Alzheimer's disease Alzheimers Dement 20139677–678.23375562 [Google Scholar]
  13. Mattsson N, Insel P, Nosheny R, Zetterberg H, Trojanowski JQ, Shaw LM, et al. CSF protein biomarkers predicting longitudinal reduction of CSF beta-amyloid42 in cognitively healthy elders. Transl Psychiatry. 2013;3:e293. doi: 10.1038/tp.2013.69. [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Box GEP, Cox DR. An analysis of transformations. J Roy Stat Soc B. 1964;26:211–252. [Google Scholar]
  15. Jack CR, Jr, Bernstein MA, Fox NC, Thompson P, Alexander G, Harvey D, et al. The Alzheimer's Disease Neuroimaging Initiative (ADNI): MRI methods. J Magn Reson Imaging. 2008;27:685–691. doi: 10.1002/jmri.21049. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Freeborough PA, Fox NC. The boundary shift integral: an accurate and robust measure of cerebral volume changes from registered repeat MRI. IEEE Trans Med Imaging. 1997;16:623–629. doi: 10.1109/42.640753. [DOI] [PubMed] [Google Scholar]
  17. Leung KK, Barnes J, Ridgway GR, Bartlett JW, Clarkson MJ, Macdonald K, et al. Automated cross-sectional and longitudinal hippocampal volume measurement in mild cognitive impairment and Alzheimer's disease. Neuroimage. 2010;51:1345–1359. doi: 10.1016/j.neuroimage.2010.03.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Schott JM, Price SL, Frost C, Whitwell JL, Rossor MN, Fox NC. Measuring atrophy in Alzheimer disease: a serial MRI study over 6 and 12 months. Neurology. 2005;65:119–124. doi: 10.1212/01.wnl.0000167542.89697.0f. [DOI] [PubMed] [Google Scholar]
  19. Klipper-Aurbach Y, Wasserman M, Braunspiegel-Weintrob N, et al. Mathematical formulae for the prediction of the residual beta cell function during the first two years of disease in children and adolescents with insulin-dependent diabetes mellitus. Med Hypotheses. 1995;45:486–490. doi: 10.1016/0306-9877(95)90228-7. [DOI] [PubMed] [Google Scholar]
  20. Benjamini Y, Drai D, Elmer G, Kafkafi N, Golani I. Controlling the false discovery rate in behavior genetics research. Behav Brain Res. 2001;125:279–284. doi: 10.1016/s0166-4328(01)00297-2. [DOI] [PubMed] [Google Scholar]
  21. Jack CR, Jr, Knopman DS, Jagust WJ, Petersen RC, Weiner MW, Aisen PS, et al. Tracking pathophysiological processes in Alzheimer's disease: an updated hypothetical model of dynamic biomarkers. Lancet Neurol. 2013;12:207–216. doi: 10.1016/S1474-4422(12)70291-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  22. Fox NC, Schott JM. Imaging cerebral atrophy: normal ageing to Alzheimer's disease. Lancet. 2004;363:392–394. doi: 10.1016/S0140-6736(04)15441-X. [DOI] [PubMed] [Google Scholar]
  23. Jack CR, Jr., Shiung MM, Gunter JL, O'Brien PC, Weigand SD, Knopman DS, et al. Comparison of different MRI brain atrophy rate measures with clinical disease progression in AD. Neurology. 2004;62:591–600. doi: 10.1212/01.wnl.0000110315.26026.ef. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Andrews KA, Modat M, Macdonald KE, Yeatman T, Cardoso MJ, Leung KK, et al. Atrophy rates in asymptomatic amyloidosis: implications for Alzheimer prevention trials. PloS One. 2013;8:e58816. doi: 10.1371/journal.pone.0058816. [DOI] [PMC free article] [PubMed] [Google Scholar]
  25. Villemagne VL, Burnham S, Bourgeat P, Brown B, Ellis KA, Salvado O, et al. Amyloid beta deposition, neurodegeneration, and cognitive decline in sporadic Alzheimer's disease: a prospective cohort study. Lancet Neurol. 2013;12:357–367. doi: 10.1016/S1474-4422(13)70044-9. [DOI] [PubMed] [Google Scholar]
  26. Whitwell JL, Petersen RC, Negash S, Weigand SD, Kantarci K, Ivnik RJ, et al. Patterns of atrophy differ among specific subtypes of mild cognitive impairment. Arch Neurol. 2007;64:1130–1138. doi: 10.1001/archneur.64.8.1130. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Blennow K, Hampel H. CSF markers for incipient Alzheimer's disease. Lancet Neurol. 2003;2:605–613. doi: 10.1016/s1474-4422(03)00530-1. [DOI] [PubMed] [Google Scholar]
  28. Probst JC, Zetzsche T, Weber M, Theilemann P, Skutella T, Landgraf R, et al. Human intestinal trefoil factor is expressed in human hypothalamus and pituitary: evidence for a novel neuropeptide. FASEB J. 1996;10:1518–1523. doi: 10.1096/fasebj.10.13.8940297. [DOI] [PubMed] [Google Scholar]
  29. Hinz M, Schwegler H, Chwieralski CE, Laube G, Linke R, Pohle W, et al. Trefoil factor family (TFF) expression in the mouse brain and pituitary: changes in the developing cerebellum. Peptides. 2004;25:827–832. doi: 10.1016/j.peptides.2004.01.020. [DOI] [PubMed] [Google Scholar]
  30. Shi HS, Yin X, Song L, Guo QJ, Luo XH. Neuropeptide Trefoil factor 3 improves learning and retention of novel object recognition memory in mice. Behav Brain Res. 2012;227:265–269. doi: 10.1016/j.bbr.2011.10.051. [DOI] [PubMed] [Google Scholar]
  31. Denton R, Meredith JE.Gamma secretase Notch biomarkersUS patent US 7,989,208; 2011.
  32. Tong G, Wang JS, Sverdlov O, Huang SP, Slemmon R, Croop R, et al. Multicenter, randomized, double-blind, placebo-controlled, single-ascending dose study of the oral gamma-secretase inhibitor BMS-708163 (Avagacestat): tolerability profile, pharmacokinetic parameters, and pharmacodynamic markers. Clin Ther. 2012;34:654–667. doi: 10.1016/j.clinthera.2012.01.022. [DOI] [PubMed] [Google Scholar]
  33. Kaur G, Levy E. Cystatin C in Alzheimer's disease. Front Mol Neurosci. 2012;5:79. doi: 10.3389/fnmol.2012.00079. [DOI] [PMC free article] [PubMed] [Google Scholar]
  34. Dutta G, Barber DS, Zhang P, Doperalski NJ, Liu B. Involvement of dopaminergic neuronal cystatin C in neuronal injury-induced microglial activation and neurotoxicity. J Neurochem. 2012;122:752–763. doi: 10.1111/j.1471-4159.2012.07826.x. [DOI] [PubMed] [Google Scholar]
  35. Religa P, Cao R, Religa D, Xue Y, Bogdanovic N, Westaway D, et al. VEGF significantly restores impaired memory behavior in Alzheimer's mice by improvement of vascular survival. Sci Rep. 2013;3:2053. doi: 10.1038/srep02053. [DOI] [PMC free article] [PubMed] [Google Scholar]
  36. McLarnon JG. Microglial chemotactic signaling factors in Alzheimer's disease. Am J Neurodegener Dis. 2012;1:199–204. [PMC free article] [PubMed] [Google Scholar]
  37. Tarkowski E, Issa R, Sjogren M, Wallin A, Blennow K, Tarkowski A, et al. Increased intrathecal levels of the angiogenic factors VEGF and TGF-beta in Alzheimer's disease and vascular dementia. Neurobiol Aging. 2002;23:237–243. doi: 10.1016/s0197-4580(01)00285-8. [DOI] [PubMed] [Google Scholar]
  38. Fagan AM, Perrin RJ. Upcoming candidate cerebrospinal fluid biomarkers of Alzheimer's disease. Biomark Med. 2012;6:455–476. doi: 10.2217/bmm.12.42. [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Blennow K, Davidsson P, Wallin A, Ekman R. Chromogranin A in cerebrospinal fluid: a biochemical marker for synaptic degeneration in Alzheimer's disease. Dementia. 1995;6:306–311. doi: 10.1159/000106963. [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary Table 1
Click here for additional data file. (166.5KB, doc)

Articles from Translational Psychiatry are provided here courtesy of Nature Publishing Group

RESOURCES