Abstract
Epigenome-wide association studies represent one means of applying genome-wide assays to identify molecular events that could be associated with human phenotypes. The epigenome is especially intriguing as a target for study, as epigenetic regulatory processes are, by definition, heritable from parent to daughter cells and are found to have transcriptional regulatory properties. As such, the epigenome is an attractive candidate for mediating long-term responses to cellular stimuli, such as environmental effects modifying disease risk. Such epigenomic studies represent a broader category of disease -omics, which suffer from multiple problems in design and execution that severely limit their interpretability. Here we define many of the problems with current epigenomic studies and propose solutions that can be applied to allow this and other disease -omics studies to achieve their potential for generating valuable insights.
The Epigenome-wide Association Study (EWAS)
“Epigenetic” processes have been defined in numerous ways: one example from Adrian Bird in 2007 uses the broad description “the structural adaptation of chromosomal regions so as to register, signal, or perpetuate altered activity states” [1]. Such activity states, when read out as transcription of genes, represent candidates for mediating between environmental, genetic, or stochastic factors and downstream phenotypes of the organism [2]. In theory, any perturbation of cellular homeostasis could be propagated through epigenetic mechanisms to cause a long-lasting phenotypic effect, especially if the perturbed cells are self-renewing stem/progenitor cells or long-lived, terminally differentiated cells. This logic has prompted an increasing number of studies [3] testing whether changes in patterns of epigenetic marks, almost always focused on DNA methylation, characterize individuals with a phenotype compared with control subjects. DNA methylation (5-methylcytosine [4]) is a covalent modification to DNA that can be faithfully propagated to daughter cells [5] and can exert transcriptional regulatory influences [6] and, therefore, has the necessary properties to mediate long-lasting perturbations of cellular states. When a pattern of changes of DNA methylation is found to occur repeatedly at specific loci, discriminating the phenotypically affected cases from control individuals, this is regarded as an indication that epigenetic perturbation has taken place that is associated, possibly causally, with the phenotype. This approach is described as an epigenome-wide association study (EWAS) [7], and takes its cue from the association of genetic variability with phenotypes in genome-wide association studies (GWAS).
The EWAS as an Exemplar of Study Designs Problems in Disease -omics
The EWAS is representative of a number of high throughput molecular assays being used for associations with phenotypes of the organism (disease -omics) and is illustrative of some common problems with these approaches, as has been previously noted [7–9]. Epigenetic patterns may change during the lifetime of an individual [10,11]; therefore, epigenetic measurements represent part of the phenotype of the individual, akin to height or blood pressure.
In contrast, genetic measurements have two key properties. The first is that the vast majority of genetic loci stay constant over an individual’s lifetime (unless somatic mutations occur, as in cancer cells). This means that any observed association of genotype with phenotype cannot be attributed to phenotype-associated events changing the genotype. The second feature is that genetic variants can be assumed to be appropriately randomly assigned with respect to the characteristics of individuals [12]. When they are not randomly assigned, the strong signal of non-randomness across the entire genome is often identified as population stratification, amenable to correction using robust statistical techniques.
Any two measurements (physical or molecular characteristics) may be correlated within a population of people; the role of the epidemiologist is to ascertain why a particular correlation exists between two measurements. The first need is to get rid of spurious associations, including biased ascertainment when collecting the case and control individuals studied, the hidden presence of common factors underlying a supposed exposure, and the disease (a confounding effect) and reverse causation (in which the disease process influences the supposedly causal process, not the other way around [13–15]), see Box 1. The constancy and random assignment of genetic characteristics allow the case/control study design to succeed, permitting results to be interpreted as causal. In contrast, epigenetic measurements have all the same dangers as any other phenotypic measurement in a case/control design, including ascertainment issues and reverse causation effects.
Box 1. Chance, Bias, and Confounding in Observational Studies
Observational studies can suffer from a wide range of problems that lead to their findings being potentially misleading. We focus on biases that generate apparent associations that do not, in fact, exist in the population studied (“spurious associations”) and associations that are misleading indicators of underlying causal relationships.
Spurious associations
Chance false positives and publication bias: When a large number of associations can be examined within a dataset, it is inevitable that, by chance, some will appear to have reasonable statistical evidence attached to them. This leads to the phenomenon of multiple testing linked to publication bias, the tendency of “statistically significant” findings being preferentially published, increasing the chances of false positive results ending up in the literature. This sequence of events is a contributory factor for the very poor replication record for published candidate gene studies, whereas in the GWAS era, robust methods were applied to correct for multiple testing.
Ascertainment and other selection biases: The ascertainment of cases of disease in case-control studies can lead to a non-random proportion of all possible cases being included in a study, with factors related to ascertainment appearing to be risk factors for the disease, even though they are not associated with the disease within the source population. Other forms of selection bias can lead to the same situation.
Reliable but non-causal associations
Confounding: An underlying factor can influence both the studied exposure and the apparent outcome, generating a non-causal but reliably observed association. For example, the oft-used example of the confounded association between yellow fingers and lung cancer—both caused by cigarette smoking—would lead to a real, but non-causal association between the two. Due to inevitable measurement error in characterizing the confounding factor, and the likelihood that there are unmeasured confounders, conventional statistical adjustment approaches have a well-documented limited ability to remove confounding adequately in observational studies.
Reverse causation: A special case of confounding is when the disease process influences the exposure, rather than vice versa. This can occur well before the disease becomes evident, thus prospective studies with assessment of risk factors before the observed development of disease are not immune to this problem.
While spurious associations always need to be avoided, reliable but non-causal associations can still be useful as predictive, prognostic, or diagnostic indicators. For example, if cellular heterogeneity in the tissue studied contributes to the age-prediction utility of DNA methylation data [17], removing the cell subtype influences analytically would be counterproductive for the use of DNA methylation as a biomarker in this case.
Problems Interpreting EWAS Results
In parallel to these epidemiological issues, there is a further layer of complexity in the interpretation of the results of the epigenomic assays. We now appreciate that reported DNA methylation differences between individuals may reflect something other than epigenetic changes in a specific cell type. One major focus has been on the potential for cell subtype proportional heterogeneity to influence the DNA methylation patterns observed in pools of cells. This was highlighted by Houseman and colleagues in a study showing that altering the proportions of purified cells in a mixture generates different DNA methylation profiles, reflecting the distinctive DNA methylation patterns of each cell type present [16]. It was subsequently shown that cell subtype effects accounted for a major proportion of the epigenetic changes associated with ageing in a re-analysis of five studies of peripheral blood leukocytes [17]. These findings of the influence of cell subtype heterogeneity prompted the development of new analytical approaches to account for this effect [16,18]. Even when cells are “purified” using cell surface markers, we find evidence for further cell subtypes with distinctive DNA methylation patterns [19]. It is, therefore, likely that even when using purification techniques, a pool of cells is composed of multiple epigenomes, generating what we refer to as a “meta-epigenome” [19].
Even after the most careful attempts to address the influence of cell subcomposition [20] or when histologically homogeneous cells are studied [21], the outcome of the EWAS generally identifies only modest changes in DNA methylation. As DNA methylation genome-wide is very bimodal, with the majority of loci in a diploid organism methylated on neither (0%) or both (100%) of the alleles present, a change of DNA methylation of, for example, 20% has to represent a changed proportion of alleles with the DNA methylation mark, in turn indicating a cellular mosaicism for the epigenetic changes associated with the phenotype. With the development of single-cell techniques to study DNA methylation [22,23], these mosaic events will be able to be confirmed experimentally. The small degree of change represents the strongest current justification for DNA methylation to be used as the primary molecular assay in EWAS, as other assays (such as those based on chromatin immunoprecipitation) have only rarely been demonstrated to have the quantitative capacity required to detect events occurring in only a subset of alleles tested [24]. From a practical perspective, it is also more challenging to collect samples for chromatin-based assays from human subjects, another reason for gravitating to the study of DNA methylation.
Similar limited degrees of change of DNA methylation are also appreciated to result from transcription through a genomic region [25,26]. A change in DNA methylation in a region that is polymorphically transcribed between individuals may, therefore, generate DNA methylation changes that are due to (and not causative of) the transcriptional changes. Of even greater concern is the influence of DNA sequence polymorphism. This influence appears to be very powerful, estimated to account for 22% to 80% of the variability (degree of change or proportion of loci) in DNA methylation between individuals [27–29]. In germline genetic studies, the complications due to variability of ancestry can be addressed through population stratification approaches and knowledge of linkage disequilibrium patterns, but no comparable strategies exist for epigenomic studies. The degree of change of DNA methylation associated with sequence polymorphism is limited, again indicating a mosaic cellular response to this influence.
As EWAS have generally been only rarely performed with concurrent genotyping of the same individuals [21,30] or transcriptional studies of the same cells [29], we have no way of knowing whether the positive results of EWAS to date are testing the starting hypothesis that genuine epigenetic changes occur within a subset of cells in the population. Instead, the results may be due to residual meta-epigenomic effects of cell subtypes or attributable to untested influences of genomic or transcriptomic variability. This being the case, and with similar caveats affecting transcriptomic studies, no EWAS to date can be said to be fully interpretable.
How to Strengthen EWAS and Other Disease -omics Study Designs
The key to improving the interpretability of epigenetic studies is their optimal planning at the outset. We illustrate some of the issues involved in designing and executing these studies in Fig 1, such as the cellular hypothesis being tested and the cohorts that could be compared. While different study designs will suit different questions, it is unfortunate that the easiest study design to execute, the cross-sectional case/control approach, is generally a suboptimal choice. This is due in part to the ascertainment issues referred to earlier and in part the possibility of reverse causation, in which the epigenomes of cells tested are influenced by (rather than part of the causal process leading to) the disease, as shown recently in a study of body mass index [31]. It is important to stress that this lack of interpretability cannot be fixed with increased sample size or choice of cell type; it is inherent to the design of the study.
A longitudinal design is advantageous for both biomarker and mechanistic insights. Longitudinal sampling of cells from an individual allowing studies prior and subsequent to disease onset allows the identification of the epigenetic changes that precede the development of the overt phenotype. This design overcomes some of the concerns raised earlier but, obviously, requires the foresight to capture informative samples from individuals who go on to develop diseases. While this seems like a major challenge, it should be recognized that epidemiologists have been developing and managing cohorts with this in mind for many decades. Banked biological material is most likely to be blood, allowing opportunities for studying the wide range of phenotypes mediated by leukocytes. In addition, one might be able to see changes in white blood cell epigenetic profiles as potential markers of exposures or predictors of disease risk or prognosis. If the epigenetic measurement is robust as a biomarker, it does not matter whether this is due to epigenetic modifications in the cells tested or reflective of cell subtype, transcriptional, or DNA sequence effects on DNA methylation. If the goal is to understand causal mechanisms, however, these confounding influences need to be taken into account.
To account for confounding biological influences, transcriptional studies of the same cells need to be performed to understand the bidirectional interactions of transcriptional and epigenetic processes. Genotyping has to be used to define the loci that are variable in response to DNA sequence differences, which may be facilitated by extracting DNA sequence variant information when bisulphite sequencing is performed to study DNA methylation [32]. The use of purified or histologically identical cells is not enough to eliminate cell subtype effects [19] but is likely to diminish this influence. Any means of quantifying cell subtype composition using cell biology approaches or analyses of molecular characteristics (such as CellMix [33]) should be employed to measure the cell subtype proportions. All of these measures are in addition to those normally applied in projects involving complex molecular assays, which require the systematic collection of experimental metadata and quality information to test whether the experiments themselves have contributed to the variability observed. We summarize these recommendations in Box 2.
Box 2. How to Improve the Interpretability of EWAS Data
We provide here a checklist of ways to improve EWAS studies:
Start with a clear hypothesis—do you seek to understand the mechanism of the disease or phenotype, in which case a mediating cell type with high purity should be studied, or do you want to identify a biomarker (of exposure or of predictive/prognostic value), in which case a surrogate, accessible cell type may be used?
Carefully consider whether your study design can answer this hypothesis. Note that using a case/control study design will, by definition, have a complex ascertainment following disease onset and will not easily discover biomarkers or causal mechanisms. This is not a property of sample size, rather a property of ascertainment.
Purify the cell type as much as possible, and use whatever means available to understand the cell subtype heterogeneity present in the tested samples.
Perform transcriptomic studies on the same cells tested for epigenetic changes and genotyping of the same individuals. This allows a number of causes and consequences of changes of epigenetic regulators to be interpreted.
Analytically, account for any epigenetic variability that is due to cell subtype, transcriptional or sequence variability, as well as any identifiable technical factors occurring during the experiments and captured as metadata.
When attempting to understand the mechanistic role of epigenetic dysregulation in the phenotype, interpret the degree of change of DNA methylation. If modest, and therefore involving a mosaic subset of cells, how does this contribute to mechanistic understanding?
Analytically, insights into DNA sequence variants upon DNA methylation (methylation quantitative trait loci, mQTLs [34]) for the cell type studied will allow approaches to be developed to account for this major influence upon the epigenome. One particular approach, two-step mendelian randomization, is being applied in prospective and case/control EWAS, building on the non-modifiable nature of germline genetic variation to provide causal anchors within a causal inference setting [35,36]. This and other new methodological approaches to integrate epigenetic, transcriptomic, and genotypic information will require the involvement of analytical specialists to work with these rich but complex datasets.
Conclusions
We focus here on the EWAS, not only because of the general lessons it allows when designing other disease -omics studies but also because we now have insights into biological influences that can influence the epigenome. Furthermore, there is the exciting possibility that well-designed studies of the epigenome can generate substantial new insights into disease mechanisms and valuable biomarkers. To realize this potential for epigenomic studies and other disease -omics, many aspects of current approaches need to be reconsidered. We provide specific recommendations for study design with the goal of prompting a discussion about how to improve the interpretability of the results when these studies are completed.
Funding Statement
The authors received no specific funding for this work.
References
- 1.Bird A (2007) Perceptions of epigenetics. Nature 447: 396–398. 10.1038/nature05913 [DOI] [PubMed] [Google Scholar]
- 2.Relton CL, Davey Smith G (2012) Is epidemiology ready for epigenetics? Int J Epidemiol 41: 5–9. 10.1093/ije/dys006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Michels KB, Binder AM, Dedeurwaerder S, Epstein CB, Greally JM, Gut I, et al. (2013) Recommendations for the design and analysis of epigenome-wide association studies. Nat Methods 10: 949–955. 10.1038/nmeth.2632 [DOI] [PubMed] [Google Scholar]
- 4.Plongthongkum N, Diep DH, Zhang K (2014) Advances in the profiling of DNA modifications: cytosine methylation and beyond. Nat Rev Genet 15: 647–661. 10.1038/nrg3772 [DOI] [PubMed] [Google Scholar]
- 5.Liu X, Gao Q, Li P, Zhao Q, Zhang J, Li J, et al. (2013) UHRF1 targets DNMT1 for DNA methylation through cooperative binding of hemi-methylated DNA and methylated H3K9. Nat Commun 4: 1563 10.1038/ncomms2562 [DOI] [PubMed] [Google Scholar]
- 6.Schübeler D (2015) Function and information content of DNA methylation. Nature 517: 321–326. 10.1038/nature14192 [DOI] [PubMed] [Google Scholar]
- 7.Rakyan VK, Down TA, Balding DJ, Beck S (2011) Epigenome-wide association studies for common human diseases. Nat Rev Genet 12: 529–541. 10.1038/nrg3000 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Heijmans BT, Mill J (2012) Commentary: The seven plagues of epigenetic epidemiology. Int J Epidemiol 41: 74–78. 10.1093/ije/dyr225 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Tsai PC, Bell JT (2015) Power and sample size estimation for epigenome-wide association scans to detect differential DNA methylation. Int J Epidemiol. 10.1093/ije/dyv041 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Horvath S (2013) DNA methylation age of human tissues and cell types. Genome Biol 14: R115 10.1186/gb-2013-14-10-r115 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Richmond RC, Simpkin AJ, Woodward G, Gaunt TR, Lyttleton O, McArdle WL, et al. (2015) Prenatal exposure to maternal smoking and offspring DNA methylation across the lifecourse: findings from the Avon Longitudinal Study of Parents and Children (ALSPAC). Hum Mol Genet 24: 2201–2217. 10.1093/hmg/ddu739 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Smith GD, Lawlor DA, Harbord R, Timpson N, Day I, Ebrahim S (2007) Clustered environments and randomized genes: a fundamental distinction between conventional and genetic epidemiology. PLoS Med 4: e352 10.1371/journal.pmed.0040352 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Sterne JA, Davey Smith G (2001) Sifting the evidence-what’s wrong with significance tests? BMJ 322: 226–231. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Smith GD, Ebrahim S (2002) Data dredging, bias, or confounding. BMJ 325: 1437–1438. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Colquhoun D (2014) An investigation of the false discovery rate and the misinterpretation of p-values. Royal Society open science 1: 140216 10.1098/rsos.140216 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Houseman EA, Accomando WP, Koestler DC, Christensen BC, Marsit CJ, Nelson HH, et al. (2012) DNA methylation arrays as surrogate measures of cell mixture distribution. BMC Bioinformatics 13: 86 10.1186/1471-2105-13-86 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Jaffe AE, Irizarry RA (2014) Accounting for cellular heterogeneity is critical in epigenome-wide association studies. Genome Biol 15: R31 10.1186/gb-2014-15-2-r31 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Houseman EA, Molitor J, Marsit CJ (2014) Reference-free cell mixture adjustments in analysis of DNA methylation data. Bioinformatics 30: 1431–1439. 10.1093/bioinformatics/btu029 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Wijetunga NA, Delahaye F, Zhao YM, Golden A, Mar JC, Einstein FH, et al. (2014) The meta-epigenomic structure of purified human stem cell populations is defined at cis-regulatory sequences. Nat Commun 5: 5195 10.1038/ncomms6195 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Liu Y, Aryee MJ, Padyukov L, Fallin MD, Hesselberg E, Runarsson A, et al. (2013) Epigenome-wide association data implicate DNA methylation as an intermediary of genetic risk in rheumatoid arthritis. Nat Biotechnol 31: 142–147. 10.1038/nbt.2487 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Berko ER, Suzuki M, Beren F, Lemetre C, Alaimo CM, Calder RB, et al. (2014) Mosaic epigenetic dysregulation of ectodermal cells in autism spectrum disorder. PLoS Genet 10: e1004402 10.1371/journal.pgen.1004402 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Farlik M, Sheffield NC, Nuzzo A, Datlinger P, Schönegger A, Klughammer J, et al. (2015) Single-cell DNA methylome sequencing and bioinformatic inference of epigenomic cell-state dynamics. Cell Rep 10: 1386–1397. 10.1016/j.celrep.2015.02.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Smallwood SA, Lee HJ, Angermueller C, Krueger F, Saadeh H, Peat J, et al. (2014) Single-cell genome-wide bisulfite sequencing for assessing epigenetic heterogeneity. Nat Methods 11: 817–820. 10.1038/nmeth.3035 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Ding Z, Ni Y, Timmer SW, Lee BK, Battenhouse A, Louzada S, et al. (2014) Quantitative genetics of CTCF binding reveal local sequence effects and different modes of X-chromosome association. PLoS Genet 10: e1004798 10.1371/journal.pgen.1004798 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Zilberman D, Gehring M, Tran RK, Ballinger T, Henikoff S (2007) Genome-wide analysis of Arabidopsis thaliana DNA methylation uncovers an interdependence between methylation and transcription. Nat Genet 39: 61–69. 10.1038/ng1929 [DOI] [PubMed] [Google Scholar]
- 26.Ball MP, Li JB, Gao Y, Lee JH, LeProust EM, Park IH, et al. (2009) Targeted and genome-scale strategies reveal gene-body methylation signatures in human cells. Nat Biotechnol 27: 361–368. 10.1038/nbt.1533 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Bell JT, Pai AA, Pickrell JK, Gaffney DJ, Pique-Regi R, Degner JF, et al. (2011) DNA methylation patterns associate with genetic and gene expression variation in HapMap cell lines. Genome Biol 12: R10 10.1186/gb-2011-12-1-r10 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Gertz J, Varley KE, Reddy TE, Bowling KM, Pauli F, Parker SL, et al. (2011) Analysis of DNA methylation in a three-generation family reveals widespread genetic influence on epigenetic regulation. PLoS Genet 7: e1002228 10.1371/journal.pgen.1002228 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Grundberg E, Meduri E, Sandling JK, Hedman AK, Keildson S, Buil A, et al. (2013) Global analysis of DNA methylation variation in adipose tissue from twins reveals links to disease-associated variants in distal regulatory elements. Am J Hum Genet 93: 876–890. 10.1016/j.ajhg.2013.10.004 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Bell JT, Tsai PC, Yang TP, Pidsley R, Nisbet J, Glass D, et al. (2012) Epigenome-wide scans identify differentially methylated regions for age and age-related phenotypes in a healthy ageing population. PLoS Genet 8: e1002629 10.1371/journal.pgen.1002629 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Richmond RC, Sharp GC, Ward ME, Fraser A, Lyttleton O, McArdle WL, et al. (2016) DNA methylation and body mass index: investigating identified methylation sites at HIF3A in a causal framework. Diabetes. 10.2337/db15-0996 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Liu Y, Siegmund KD, Laird PW, Berman BP (2012) Bis-SNP: combined DNA methylation and SNP calling for Bisulfite-seq data. Genome Biol 13: R61 10.1186/gb-2012-13-7-r61 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Gaujoux R, Seoighe C (2013) CellMix: a comprehensive toolbox for gene expression deconvolution. Bioinformatics 29: 2211–2212. 10.1093/bioinformatics/btt351 [DOI] [PubMed] [Google Scholar]
- 34.Gibbs JR, van der Brug MP, Hernandez DG, Traynor BJ, Nalls MA, Lai SL, et al. (2010) Abundant quantitative trait loci exist for DNA methylation and gene expression in human brain. PLoS Genet 6: e1000952 10.1371/journal.pgen.1000952 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Davey Smith G, Hemani G (2014) Mendelian randomization: genetic anchors for causal inference in epidemiological studies. Hum Mol Genet 23: R89–R98. 10.1093/hmg/ddu328 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Relton CL, Davey Smith G (2012) Two-step epigenetic Mendelian randomization: a strategy for establishing the causal role of epigenetic processes in pathways to disease. Int J Epidemiol 41: 161–176. 10.1093/ije/dyr233 [DOI] [PMC free article] [PubMed] [Google Scholar]