Generative modeling of multi-mapping reads with mHi-C advances analysis of Hi-C studies

Ye Zheng; Ferhat Ay; Sunduz Keles

doi:10.7554/eLife.38070

. 2019 Jan 31;8:e38070. doi: 10.7554/eLife.38070

Generative modeling of multi-mapping reads with mHi-C advances analysis of Hi-C studies

Ye Zheng ¹, Ferhat Ay ^2,³, Sunduz Keles ^1,^4,^✉

Editors: Bing Ren⁵, Naama Barkai⁶

PMCID: PMC6450682 PMID: 30702424

Abstract

Current Hi-C analysis approaches are unable to account for reads that align to multiple locations, and hence underestimate biological signal from repetitive regions of genomes. We developed and validated mHi-C, a multi-read mapping strategy to probabilistically allocate Hi-C multi-reads. mHi-C exhibited superior performance over utilizing only uni-reads and heuristic approaches aimed at rescuing multi-reads on benchmarks. Specifically, mHi-C increased the sequencing depth by an average of 20% resulting in higher reproducibility of contact matrices and detected interactions across biological replicates. The impact of the multi-reads on the detection of significant interactions is influenced marginally by the relative contribution of multi-reads to the sequencing depth compared to uni-reads, cis-to-trans ratio of contacts, and the broad data quality as reflected by the proportion of mappable reads of datasets. Computational experiments highlighted that in Hi-C studies with short read lengths, mHi-C rescued multi-reads can emulate the effect of longer reads. mHi-C also revealed biologically supported bona fide promoter-enhancer interactions and topologically associating domains involving repetitive genomic regions, thereby unlocking a previously masked portion of the genome for conformation capture studies.

Research organism: Human, Mouse

Introduction

DNA is highly compressed in the nucleus and organized into a complex three-dimensional structure. This compressed form brings distal functional elements into close spatial proximity of each other (Dekker et al., 2002; de Laat and Duboule, 2013) and has a far-reaching influence on gene regulation. Changes in DNA folding and chromatin structure remodeling may result in cell malfunction with devastating consequences (Corradin et al., 2016; Won et al., 2016; Javierre et al., 2016; Rosa-Garrido et al., 2017; Spielmann et al., 2018). Hi-C technique (Lieberman-Aiden et al., 2009; Rao et al., 2014) emerged as a high throughput technology for interrogating the three-dimensional configuration of the genome and identifying regions that are in close spatial proximity in a genome-wide fashion. Thus, Hi-C data is powerful for discovering key information on the roles of the chromatin structure in the mechanisms of gene regulation.

There are a growing number of published and well-documented Hi-C analysis tools and pipelines (Heinz et al., 2010; Hwang et al., 2015; Ay et al., 2014a; Servant et al., 2015; Mifsud et al., 2015; Lun and Smyth, 2015), and their operating characteristics were recently studied (Ay and Noble, 2015; Forcato et al., 2017; Yardımcı et al., 2017) in detail. However, a key and common step in these approaches is the exclusive use of uniquely mapping reads. Limiting the usable reads to only uniquely mapping reads underestimates signal originating from repetitive regions of the genome which are shown to be critical for tissue specificity (Xie et al., 2013). Such reads from repetitive regions can be aligned to multiple positions (Figure 1A) and are referred to as multi-mapping reads or multi-reads for short. The critical drawbacks of discarding multi-reads have been recognized in other classes of genomic studies such as transcriptome sequencing (RNA-seq) (Li and Dewey, 2011), chromatin immunoprecipitation followed by high throughput sequencing (ChIP-seq) (Chung et al., 2011; Zeng et al., 2015), as well as genome-wide mapping of protein-RNA binding sites (CLIP-seq or RIP-seq) (Zhang and Xing, 2017). More recently, (Sun et al., 2018) and (Cournac et al., 2016) argued for a fundamental role of repeat elements in the 3D folding of genomes, highlighting the role of higher order chromatin architecture in repeat expansion disorders. However, the ambiguity of multi-reads alignment renders it a challenge to investigate the repetitive elements co-localization with the true 3D interaction architecture and signals. In this work, we developed mHi-C (Figure 1—figure supplements 1 and 2), a hierarchical model that probabilistically allocates Hi-C multi-reads to their most likely genomic origins by utilizing specific characteristics of the paired-end reads of the Hi-C assay. mHi-C is implemented as a full analysis pipeline (https://github.com/keleslab/mHiC) that starts from unaligned read files and produces a set of statistically significant interactions at a given resolution. We evaluated mHi-C both by leveraging replicate structure of public of Hi-C datasets of different species and cell lines across six different studies, and also with computational trimming and data-driven simulation experiments.

Figure 1. — (A) Standard Hi-C pipelines utilize uni-reads while discarding multi-mapping reads which give rise to multiple potential contacts. (B) The total number of reads in different categories as a result of alignment to reference genome across the study datasets. Percentages of high-quality multi-reads compared to uni-reads are depicted on top of each bar. (C) Multi-mapping reads can be reduced to uni-reads within validation checking and genome binning pre-processing steps. (D) Aligned reads after validation checking and binning. Percentage improvements in sequencing depths due to multi-reads becoming uni-reads are depicted on top of each bar. (E) mHi-C modeling starts from the prior built by only uni-reads to quantify the relationship between random contact probabilities and the genomic distance between the contacts. This prior is updated by leveraging local bin pair contacts including both uni- and multi-reads and results in posterior probabilities that quantify the evidence for each potential contact to be the true genomic origin.

Figure 1—source data 1. Detailed summary of study datasets.

elife-38070-fig1-data1.xlsx^{(31KB, xlsx)}

DOI: 10.7554/eLife.38070.009

Figure 1—figure supplement 1. — (A) Standard Hi-C pipelines utilize uni-reads while discarding multi-mapping reads which give rise to multiple potential contacts. (B) The total number of reads in different categories as a result of alignment to reference genome across the study datasets. Percentages of high-quality multi-reads compared to uni-reads are depicted on top of each bar. (C) Multi-mapping reads can be reduced to uni-reads within validation checking and genome binning pre-processing steps. (D) Aligned reads after validation checking and binning. Percentage improvements in sequencing depths due to multi-reads becoming uni-reads are depicted on top of each bar. (E) mHi-C modeling starts from the prior built by only uni-reads to quantify the relationship between random contact probabilities and the genomic distance between the contacts. This prior is updated by leveraging local bin pair contacts including both uni- and multi-reads and results in posterior probabilities that quantify the evidence for each potential contact to be the true genomic origin.

Figure 1—source data 1. Detailed summary of study datasets.

elife-38070-fig1-data1.xlsx^{(31KB, xlsx)}

DOI: 10.7554/eLife.38070.009

Results

Multi-reads significantly increase the sequencing depths of Hi-C data

For developing mHi-C and studying its operating characteristics, we utilized six published studies, resulting in eight datasets with multiple replicates, as summarized in Table 1 and with more details in Figure 1—source data 1: Table 1. These datasets represent a variety of study designs from different organisms, that is human and mouse cell lines as examples of large genomes and three different stages of Plasmodium falciparum red blood cell cycle as an example of a small and AT-rich genome. Specifically, they span a wide range of sequencing depths (Figure 1B), coverages and cis-to-trans ratios (Figure 1—figure supplement 3), and have different proportions of mappable and valid reads (Figure 1—figure supplement 4). Before applying mHi-C to these datasets and investigating biological implications, we first established the substantial contribution of multi-reads to the sequencing depth across these datasets with diverse characteristics. At read-end level (Supplementary file 1 for terminology), after the initial step of aligning to the reference genome (Figure 1—figure supplements 1 and 2), multi-reads constitute approximately 10% of all the mappable read ends (Figure 1—figure supplement 5A). Moreover, the contribution of multi-reads to the set of aligned reads further increases by an additional 8% when chimeric reads (Supplementary file 1) are also taken into account (Figure 1—source data 1: Table 2). Most notably, Figure 1—figure supplement 6A demonstrates that, in datasets with shorter read lengths, multi-reads constitute a larger percentage of usable reads compared to uniquely mapping chimeric reads that are routinely rescued in Hi-C analysis pipelines (Servant et al., 2015; Lun and Smyth, 2015; Durand et al., 2016). Moreover, multi-reads also make up a significant proportion of the rescued chimeric reads (Figure 1—figure supplement 6B). At the read pair level, after joining of both ends, multi-reads increase the sequencing depth by 18% to 23% for shorter read length datasets and 10% to 15% for longer read lengths, thereby providing a substantial increase to the depth before the read pairs are further processed into bin pairs (Figure 1C; Figure 1—source data 1: Table 3).

Table 1. Hi-C Data Summary.

Cell line	Replicate	Read length (bp)	Restriction enzyme	HiC protocol	Source	Resolution (kb)
IMR90	rep1-6	36	HindIII	dilution	(Jin et al., 2013)	40
GM12878	rep2-9	101	MboI	in situ	(Rao et al., 2014)	5, 10, 40
GM12878	rep32, rep33	101	DpnII	in situ	(Rao et al., 2014)	5
A549	rep1-4	151	MboI	in situ	(Dixon et al., 2018)	10, 40
ESC(2012)	rep1, rep2	36	HindIII	dilution	(Dixon et al., 2012)	40
ESC(2017)	rep1-4	50	DpnII	in situ	(Bonev et al., 2017)	10, 40
Cortex	rep1-4	50	DpnII	in situ	(Bonev et al., 2017)	10, 40
P. falciparum	three stages	40	MboI	dilution	(Ay et al., 2014b)	10, 40

Open in a new tab

^*Replicates 2, 3, 4, and 6 of the GM12878 cell line datasets were process at 10 kb and 40 kb resolutions.

Multi-reads can be rescued at multiple processing stages of mHi-C pipeline

As part of the post-alignment pre-processing steps, Hi-C reads go through a series of validation checking to ensure that the reads that represent biologically meaningful fragments are retained and used for downstream analysis (Figure 1—figure supplements 1 and 2, Supplementary file 1). mHi-C pipeline tracks multi-reads through these processing steps. Remarkably, in the application of mHi-C to all six studies, a subset of the high-quality multi-reads are reduced to uni-reads either in the validation step when only one candidate contact passes the validation screening, or because all the alignments of a multi-read reside within the same bin (Figure 1C; Supplementary file 1 and see Materials and methods). Collectively, mHi-C can rescue as high as 6.7% more valid read pairs (Figure 1D) that originate from multi-reads and are mapped unambiguously without carrying out any multi-reads specific procedure for large genomes and 10.4% for P. falciparum. Such improvement corresponds to millions of reads for deeper sequenced datasets (Figure 1—source data 1: Table 4). For the remaining multi-reads (Figure 1D, colored in pink), which, on average, make up 18% of all the valid reads (Figure 1—figure supplement 5B), mHi-C implements a novel multi-mapping model and probabilistically allocates them.

mHi-C generative model (Figure 1E and see Materials and methods) is constructed at the bin-pair level to accommodate the typical signal sparsity of genomic interactions. The bins are either fixed-size non-overlapping genome intervals or a fixed number of restriction fragments derived from the Hi-C protocol. The resolutions at which seven cell lines are processed are summarized in Table 1. In the mHi-C generative model, we denote the observed alignment indicator vector for a given paired-end read $i$ by vector $Y_{i}$ and use unobserved hidden variable vector $Z_{i}$ to indicate its true genomic origin. Contacts captured by Hi-C assay can arise as random contacts of nearby genomic positions or true biological interactions. mHi-C generative model acknowledges this feature by utilizing data-driven priors, $π_{(j, k)}$ for bin pairs $j$ and $k$ , as a function of contact distance between the two bins. mHi-C updates these prior probabilities for each candidate bin pair that a multi-read can be allocated to by leveraging local contact counts. As a result, for each multi-read $i$ , it estimates posterior probabilities of genomic origin variable $Z_{i}$ . Specifically, $P r (Z_{i, (j, k)}$ = 1 $| 𝒀_{𝒊}$ $Y_{i}, π)$ denotes the posterior probability, that is allocation probability, that the two read ends of multi-read $i$ originate from bin pairs $j$ and $k$ . These posterior probabilities, which can also be viewed as fractional contacts of multi-read $i$ , are then utilized to assign each multi-read to the most likely genomic origin. Our results in this paper only utilized reads with allocation probability greater than 0.5. This ensured the output of mHi-C to be compatible with the standard input of the downstream normalization and statistical significance estimation methods (Imakaev et al., 2012; Knight and Ruiz, 2013; Ay et al., 2014a).

Probabilistic assignment of multi-reads results in more complete contact matrices and significantly improves reproducibility across replicates

Before quantifying mHi-C model performance, we provide a direct visual comparison of the contact matrices between Uni-setting and Uni&Multi-setting using raw and normalized contact counts. Figure 2A and Figure 2—figure supplements 1–4 clearly illustrate how multi-mapping reads fill in the low mappable regions and lead to more complete matrices, corroborating that repetitive genomic regions are under-represented without multi-reads. Quantitatively, for the combined replicates of GM12878, 99.61% of the 5 kb bins with interaction potential are covered by at least 100 raw contacts under the Uni&Multi-setting, compared to 98.72% under Uni-setting, thereby allowing us to study 25.55 Mb more of the genome. For normalized contact matrices, the coverage increases from 99.42% in Uni-setting to 99.97% in Uni&Multi-setting (Figure 2—figure supplement 5). In addition to increasing the sequencing depth in extremely low contact bins for both raw and normalized contact counts, higher bin-level coverage after leveraging multi-mapping reads appears as a global pattern across the genome for raw contact matrices (Figure 2—figure supplements 6 and 7). Figure 2—figure supplement 8 provides the histogram of bin-level differences of normalized contact counts between the two settings and indicates a positive average difference. While some bins appear to have their contact counts decreased in the Uni&Multi-setting compared to Uni-setting after normalization (purple bar in Figure 2—figure supplement 8A), comparison of the raw contact counts in Figure 2—figure supplement 8B shows that these bins do indeed have lower raw contact counts in the Uni-setting compared to Uni&Multi-setting and that the reduction observed is an artifact of normalization. This also highlights that multi-reads alleviate the inflation of low raw contact count regions due to normalization. These major improvements in coverage provide direct evidence that mHi-C is rescuing multi-reads that originate from biologically valid fragments.

Figure 2. — (A) Contact matrices of GM12878 with combined reads from replicates 2–9 are compared under Uni-setting and Uni&Multi-setting using raw and normalized contact counts for chr6:25.5 Mb - 28.5 Mb. White gaps of Uni-reads contact matrix, due to lack of reads from repetitive regions, are filled in by multi-reads, hence resulting in a more complete contact matrix. Such gaps remain in the Uni-setting even after normalization. Red squares at the left bottom of the matrices indicate the color scale. (B) Reproducibility of Hi-C contact matrices by HiCRep across all pairwise comparisons between replicates under the Uni- and Uni&Multi-settings (IMR90 and GM12878 are displayed). (C) Reproducibility of the significant interactions across replicates of the study datasets. Reproducibility is assessed by overlapping interactions detected at FDR of 5% for pairs of replicates within each study dataset.

Figure 2—figure supplement 1. — (A) Contact matrices of GM12878 with combined reads from replicates 2–9 are compared under Uni-setting and Uni&Multi-setting using raw and normalized contact counts for chr6:25.5 Mb - 28.5 Mb. White gaps of Uni-reads contact matrix, due to lack of reads from repetitive regions, are filled in by multi-reads, hence resulting in a more complete contact matrix. Such gaps remain in the Uni-setting even after normalization. Red squares at the left bottom of the matrices indicate the color scale. (B) Reproducibility of Hi-C contact matrices by HiCRep across all pairwise comparisons between replicates under the Uni- and Uni&Multi-settings (IMR90 and GM12878 are displayed). (C) Reproducibility of the significant interactions across replicates of the study datasets. Reproducibility is assessed by overlapping interactions detected at FDR of 5% for pairs of replicates within each study dataset.

We assessed the impact of multi-reads rescued by mHi-C on the reproducibility from the point of both raw contact counts and significant interactions detected. We used the stratum-adjusted correlation coefficient proposed in HiCRep (Yang et al., 2017) for evaluating the reproducibility of Hi-C contact matrices. Figure 2B and Figure 2—figure supplements 9 and 10 illustrate that integrating multi-reads leads to increased reproducibility and reduced variability of stratum-adjusted correlation coefficients among biological replicates across all the study datasets. Furthermore, we observe that, for some chromosomes, for example, chr17 of IMR90 and chr16 of GM12878, the improvement in reproducibility stands out, without a systematic behavior across datasets. A close examination of improvement in reproducibility as a function of the ratio of rescued multi-reads to uni-reads across chromosomes highlights the larger proportion of multi-reads rescued for these chromosomes (Figure 2—figure supplement 11). To further assess that the improvement in reproducibility did not manifest due to an unaccounted systematic bias in the assignment of multi-reads, we evaluated reproducibility similarly between replicates of GM12878 and replicates of IMR90. Figure 2—figure supplement 12 shows that Uni-setting and Uni&Multi-setting lead to similar levels of reproducibility between replicates of these unrelated samples with all Wilcoxon rank-sum test p-values of the pairwise comparisons between Uni- and Uni&Multi-settings > 0.21; therefore, ruling out the possibility of a systematic bias as the source of improvement in reproducibility due to multi-reads.

In addition to the direct comparison of the raw contact matrices and their reproducibility, we identified the set of significant interactions by Fit-Hi-C (Ay et al., 2014a) and assessed the reproducibility of the identified interactions. Figure 2C shows that mHi-C significantly improves reproducibility of detected interactions across all the pairwise comparisons of replicates within each study dataset. Figure 2—figure supplement 13A presents more details on the degree of overlap among the significant interactions identified at 5% and 10% false discovery rate (FDR) across replicates for the IMR90 datasets. These comparisons highlight that significant interactions specific to Uni&Multi-setting have consistently higher reproducibility than those specific to Uni-setting across all pairwise comparisons. Since random contacts tend to arise due to short genomic distances between loci, we stratified the significant interactions based on distance and reassessed the reproducibility as a function of the genomic distance between the contacts (Figure 2—figure supplement 13B). Notably, significant interactions identified only by the Uni-setting and those common to both settings have a stronger gradual descending trend as a function of the genomic distance, indicating decaying reproducibility for long-range interactions. In contrast, Uni&Multi-setting maintains a relatively higher and stable reproducibility for longer genomic distances.

2.4 Multi-reads detect novel significant interactions

At 5% false discovery rate, mHi-C detects 20% to 50% more novel significant interactions for relatively highly sequenced study datasets (Figure 3A and Figure 3—source data 1; Figure 3—figure supplement 1 for other FDR thresholds and resolutions). The gains are markedly larger for datasets with smaller sequencing depths (e.g., ESC-2012) or extremely high coverage (e.g., P. falciparum). Overall gains in the number of novel contacts persist as the cutoff for mHi-C posterior probabilities of multi-read assignments varies (Figure 3—figure supplement 2). At fixed FDR, significant interactions identified by the Uni&Multi-setting also include the majority of significant interactions inferred from the Uni-setting, indicating that incorporating multi-reads is extending the significant interaction list (low level of purple lines in Figure 3—figure supplement 2).

Figure 3—figure supplement 1. — (A) Percentage increase in detected significant interactions (FDR 5%) by comparing contacts identified in Uni&Multi-setting with those of Uni-setting across study datasets at 40 kb resolution. (B) Percentage change in the numbers of significant interactions (FDR 5%) as a function of the percentage of mHi-C rescued multi-reads in comparison to uni-read and *cis*-to-*trans* ratios of individual datasets at 40 kb resolution. (C) Recovery of significant interactions identified at 1% FDR by analysis at 10% FDR, aggregated over the replicates of GM12878 at 40 kb resolution. Detailed descriptions of the groups are provided in Figure 3—figure supplement 6. (D) Average number of contacts falling within the significant interactions (5% FDR) that overlapped with each chromHMM annotation category across six replicates of IMR90 identified by Uni- and Uni&Multi-settings. (E) Average number of contacts (5% FDR) that overlapped with significant interactions and different types of ChIP-seq peaks associated with different genomic functions (IMR90 six replicates). Red/Green labels denote smaller/larger differences between the two settings compared to the differences observed in the ”Others’ category that depict non-peak regions.

Figure 3—source data 1. Percentage of improvement in the number of significant interactions across six studies at resolution 40 kb.

elife-38070-fig3-data1.xlsx^{(11.2KB, xlsx)}

DOI: 10.7554/eLife.38070.043

We leveraged the diverse characteristics of the study datasets and investigated the factors that impacted the gain in the detected significant interactions due to multi-reads. The top row of Figure 3—figure supplement 3 summarizes the marginal correlations of the percentage change in the number of identified significant interactions (at 40 kb resolution and FDR of 0.05) with the data characteristics commonly used to indicate the quality of Hi-C datasets (excluding the high coverage P. falciparum dataset). These marginal associations highlight the significant impact of the relative contribution of multi-reads to the sequencing depth compared to uni-reads and cis-to-trans ratio of contacts (Figure 3—figure supplement 4). Figure 3—figure supplement 5 increase in the number of novel significant interactions for the GM12878 datasets in more detail across a set of FDR thresholds and at different resolutions, and includes two types of restriction enzymes. Specifically, Figure 3—figure supplement 5C illustrates a clear negative association between the sequencing depth and the percent improvement in the number of identified significant interactions at 5 kb resolution due to the larger impact of multi-reads on the smaller depth replicates. As an exception, we note that P. falciparum datasets tend to exhibit significantly higher gains in the number of identified contacts especially under stringent FDR thresholds (Figure 3A), possibly due to the ultra-high coverage of these datasets (Figure 3—figure supplement 6). In addition to these marginal associations, Figure 3B and Figure 3—figure supplement 7 display the percentage increase in the number of identified significant interactions as a function of the percentage increase in the real depth due to multi-reads and the cis-to-trans ratio across all the study datasets. A consistent pattern highlights that short read datasets with large proportion of mHi-C rescued multi-reads compared to uni-reads enjoy a larger increase in the number of identified significant interactions regardless of the FDR threshold, while for datasets with similar relative contribution of multi-reads, for example within lower depth IMR90, cis-to-trans ratios positively correlate with the increase in the number of identified significant interactions.

We next asked whether novel significant interactions due to rescued multi-reads could have been identified under the Uni-setting by employing a more liberal FDR threshold. Leveraging multi-reads with posterior probability larger than 0.5 and controlling the FDR at 1%, Fit-Hi-C identified 32.49% more significant interactions compared to Uni-setting (comparing dark green to dark purple bar in Figure 3C) and 36.43% of all significant interactions are unique to Uni&Multi-setting (light green bar over dark green bar in Figure 3C) collectively for all the four replicates of GM12878 at 40 kb resolution. We observed that 34.89% of these novel interactions (yellow bar over the light green bar in Figure 3C) at 1% FDR (i.e., 12.71% compared to the all the significant interactions under Uni&Multi-setting) cannot be recovered even by a more liberal significant interaction list under Uni-setting at 10% FDR. Conversely, Uni&Multi-setting is unable to recover only 4.60% of the Uni-setting contacts once the FDR is controlled at 10% for the Uni&Multi-setting (light blue over dark purple bar in Figure 3C), highlighting again that Uni&Multi-setting predominantly adds on novel significant interactions while retaining interactions that are identifiable under the Uni-setting. A similar analysis for individual replicates of IMR90 are provided in Figure 3—figure supplement 8 as well as those of GM12878 at the individual replicate level or collective analysis at 5 kb, 10 kb, and 40 kb resolutions in Figure 3—figure supplements 9–12. We further confirmed this consistent power gain by a Receiver Operating Characteristic (ROC) and a Precision-Recall (PR) analysis (Figure 3—figure supplement 13). The PR curve illustrates that at the same false discovery rate (1-precision), mHi-C achieves consistently higher power (recall) than the Uni-setting in addition to better AUROC performance.

Chromatin features of novel significant interactions

To further establish the biological implications of mHi-C rescued multi-reads, we investigated genomic features of novel contacts. Annotation of the significant interactions with ChromHMM segmentations from the Roadmap Epigenomics project (Kundaje et al., 2015) highlights marked enrichment of significant interactions in annotations involving repetitive DNA (Figure 3D, Figure 3—figure supplement 14A). Most notably, ZNF genes and repeats and Heterochromatin states exhibit the largest discrepancy of the average significant interaction counts between the Uni- and Uni&Multi-settings. To complement the evaluation with ChromHMM annotations, we evaluated the Uni-setting and Uni&Multi-setting significant interaction enrichment of genomic regions harboring histone marks and other biochemical signals (ENCODE Project Consortium, 2012; Jin et al., 2013) (See Materials and methods) by comparing their average contact counts to those without such signal (Figure 3E and data on Dryad, https://doi.org/10.5061/dryad.v7k3140). Notably, while we observe that multi-reads boost the average number of contacts with biochemically active regions of the genome, they contribute more to regions that harbor H3K27me3 peaks (Figure 3E, Figure 3—figure supplement 14B). Such regions are associated with downregulation of nearby genes through forming heterochromatin structure (Ferrari et al., 2014). Figure 3—figure supplement 15–17 further provide specific examples of how increased marginal contact counts due to multi-reads are supported by signals of histone modifications, CTCF binding sites, and gene expression. Many genes of biological significance reside in these regions. For example, NBPF1 (Figure 3—figure supplement 15) is implicated in many neurogenetic diseases and its family consists of dozens of recently duplicated genes primarily located in segmental duplications (Safran et al., 2010). In addition, RABL2A within the highlighted region of Figure 3—figure supplement 16 is a member of RAS oncogene family.

Multi-reads discover novel promoter-enhancer interactions

We found that a significant impact of multi-reads is on the detection of promoter-enhancer interactions. Overall, mHi-C identifies 14.89% more significant promoter-enhancer interactions at 5% FDR collectively for six replicates for IMR90 (Figure 4—source data 1: Table 1 and Figure 4—source data 2). Of these interactions, 13,313 are reproducible among all six replicates under Uni&Multi-setting (Figure 4—source data 1: Table 2) and 62,971 are reproducible for at least two replicates (Figure 4—source data 1: Table 3) leading to 15.84% more novel promoter-enhancer interactions specific to Uni&Multi-setting. Figure 4A provides WashU epigenome browser (Zhou et al., 2011) display of such novel reproducible promoter-enhancer interactions on chromosome 1. Figure 4—figure supplements 1–2 provides more such reproducible examples and Figure 4—figure supplement 3 depicts the reproducibility of these interactions in more details across the six replicates.

Figure 4. — (A) mHi-C identifies novel significant promoter-enhancer interactions (green arcs) that are reproducible among at least two replicates in addition to those reproducible under the Uni-setting (purple arcs). Shaded and the boxed regions correspond to the anchor and target bins, respectively. The top track displays the contact counts associated with the anchor bin under Uni- and Uni&Multi-settings. Related chromHMM annotation color labels are added around the track. The complete color labels are consistent with ChromHMM 15-state model at https://egg2.wustl.edu/roadmap/web_portal/chr_state_learning.html. (B) Average gene expression with standard errors for five different scenarios of interactions that group promoters into six different categories. In the first panel, significant interactions involving promoters are classified into five settings, and the average gene expressions across genes with the corresponding promoters are depicted. The second panel involves two alignment settings and genes without any promoter interactions at 5% FDR. This panel is further separated into two categories: promoters that overlap with enhancer annotated regions and those that do not. The latter one serves as the baseline for average expression. Genes contributing to the third and fourth panel have promoter-enhancer, promoter-promoter interactions at 5% FDR. The fifth panel considers genes promoters of which have significant interactions with non-enhancer and non-promoter regions. Numbers in the parenthesis correspond to the number of transcripts in each category.

Figure 4—source data 1. The number of significant promoter-enhancer Hi-C interactions at FDR 5% under Uni-setting and Uni&Multi-setting, respectively, for six replicates of IMR90.

elife-38070-fig4-data1.xlsx^{(11.5KB, xlsx)}

DOI: 10.7554/eLife.38070.049

Figure 4—source data 2. Significant promoter-enhancer interactions at FDR 5% under Uni-setting and Uni&Multi-setting for six replicates of IMR90 with the number of contacts.

elife-38070-fig4-data2.zip^{(13.5MB, zip)}

DOI: 10.7554/eLife.38070.050

Figure 4—figure supplement 1. — (A) mHi-C identifies novel significant promoter-enhancer interactions (green arcs) that are reproducible among at least two replicates in addition to those reproducible under the Uni-setting (purple arcs). Shaded and the boxed regions correspond to the anchor and target bins, respectively. The top track displays the contact counts associated with the anchor bin under Uni- and Uni&Multi-settings. Related chromHMM annotation color labels are added around the track. The complete color labels are consistent with ChromHMM 15-state model at https://egg2.wustl.edu/roadmap/web_portal/chr_state_learning.html. (B) Average gene expression with standard errors for five different scenarios of interactions that group promoters into six different categories. In the first panel, significant interactions involving promoters are classified into five settings, and the average gene expressions across genes with the corresponding promoters are depicted. The second panel involves two alignment settings and genes without any promoter interactions at 5% FDR. This panel is further separated into two categories: promoters that overlap with enhancer annotated regions and those that do not. The latter one serves as the baseline for average expression. Genes contributing to the third and fourth panel have promoter-enhancer, promoter-promoter interactions at 5% FDR. The fifth panel considers genes promoters of which have significant interactions with non-enhancer and non-promoter regions. Numbers in the parenthesis correspond to the number of transcripts in each category.

Figure 4—source data 1. The number of significant promoter-enhancer Hi-C interactions at FDR 5% under Uni-setting and Uni&Multi-setting, respectively, for six replicates of IMR90.

elife-38070-fig4-data1.xlsx^{(11.5KB, xlsx)}

DOI: 10.7554/eLife.38070.049

Figure 4—source data 2. Significant promoter-enhancer interactions at FDR 5% under Uni-setting and Uni&Multi-setting for six replicates of IMR90 with the number of contacts.

elife-38070-fig4-data2.zip^{(13.5MB, zip)}

DOI: 10.7554/eLife.38070.050

We next validated the novel promoter-enhancer interactions by investigating the expression levels of the genes contributing promoters to these interactions. Figure 4B supports that genes with significant interactions in their promoters generally exhibit higher expression levels (comparing bars 1–5 to bars 8–9 in Figure 4B). Furthermore, if these interactions involve an enhancer, the average gene expression can be 38.17% higher than that of the overall promoters with significant interactions (comparing bars 10–11 to bars 1–2 in Figure 4B). Most remarkably, newly detected significant promoter-enhancer interactions (bar 13 in Figure 4B) exhibit a stably higher gene expression level, highlighting that, without multi-reads, biologically supported promoter-enhancer interactions are underestimated. In addition, an overall evaluation of significant interactions (5% FDR) that considers interactions from promoters with low expression (TPM $\leq$ 1) as false positives illustrate that mHi-C specific significant promoter interactions have false positive rates comparable to or smaller than those of significant promoter interactions common to Uni- and Uni&Multi-settings (Figure 4—figure supplement 4). In contrast, Uni-setting specific interactions have elevated false positive rates.

Multi-reads refine the boundaries of topologically associating domains

We next investigated the impact of mHi-C rescued multi-reads on the topologically associating domains (TADs) (Pombo and Dillon, 2015), where we used a broad definition of TADs to include contact and loop domains. We used the DomainCaller (Dixon et al., 2012; Dixon et al., 2015) to infer TADs of IMR90 datasets at 40 kb resolution and Arrowhead (Rao et al., 2014) for GM12878 datasets at 5 kb resolution under Uni&Multi-settings (Figure 5—source data 1 and 2). The detected TADs are compared to those under the Uni-setting. While this comparison did not reveal stark differences in the numbers of TADs identified under the two settings (Figure 5—figure supplement 1), we found that Uni&Multi-setting identifies 2.01% more reproducible TADs with 2.36% lower non-reproducible TADs across replicates (Figure 5A). Several studies have revealed the role of CTCF in establishing the boundaries of genome architecture (Ong and Corces, 2014; Tang et al., 2015; Hsu et al., 2017). While this is an imperfect indicator of TAD boundaries, we observed that a slightly higher proportion of the detected TADs have CTCF peaks with convergent CTCF motif pairs at the boundaries once multi-reads are utilized (Figure 5—figure supplement 2A–C). Figure 5B provides an explicit example of how the gap in the contact matrix due to depletion of multi-reads biases the inferred TAD structure. In addition to discovery of novel TADs (Figure 5—figure supplement 3) by filling in the gaps in the contact matrix and boosting the domain signals, mHi-C also refines TAD boundaries (Figure 5—figure supplements 4 and 5), and eliminates potential false positive TADs that are split by the contact depleted gaps in Uni-setting (Figure 5—figure supplements 6–8). The novel, adjusted, and eliminated TADs are largely supported by CTCF signal identified using both uni- and multi-reads ChIP-seq datasets (Zeng et al., 2015) as well as convergent CTCF motifs (Figure 5—figure supplement 2D), providing support for mHi-C driven modifications to these TADs and revealing a slightly lower false discovery rate for mHi-C compared to Uni-setting (Figure 5C, Figure 5—figure supplement 2E, and Figure 5—figure supplement 9).

Figure 5. — (A) Percentage of topologically associating domains (TADs) that are reproducibly detected under Uni-setting and Uni&Multi-setting. TADs that are not detected in at least 4 of the six replicates are considered as non-reproducible. (B) Comparison of the contact matrices with superimposed TADs between Uni- and Uni&Multi-setting for chr10:72,550,000–97,550,000. Red squares at the left bottom of the matrices indicate the color scale. TADs affected by white gaps involving repetitive regions are highlighted in light green. Light green outlined areas correspond to new TAD boundaries. (C) False discovery rate of TADs detected under two settings. TADs that are not reproducible and lack CTCF peaks at the TAD boundaries are labeled as false positives. (D) Average number of repetitive elements at the boundaries of reproducible TADs compared to those within TADs and genomewide intervals of the same size for GM12878 at 5 kb resolution.

Figure 5—source data 1. Topologically associating domains detected by DomainCaller (Dixon et al., 2012) under Uni&Multi-setting for six replicates of IMR90.

elife-38070-fig5-data1.zip^{(94.5KB, zip)}

DOI: 10.7554/eLife.38070.064

Figure 5—source data 2. Topologically associating domains detected by Arrowhead (Rao et al., 2014) under Uni&Multi-setting for ten replicates of GM12878.

elife-38070-fig5-data2.zip^{(380.2KB, zip)}

DOI: 10.7554/eLife.38070.065

Figure 5—figure supplement 1. — (A) Percentage of topologically associating domains (TADs) that are reproducibly detected under Uni-setting and Uni&Multi-setting. TADs that are not detected in at least 4 of the six replicates are considered as non-reproducible. (B) Comparison of the contact matrices with superimposed TADs between Uni- and Uni&Multi-setting for chr10:72,550,000–97,550,000. Red squares at the left bottom of the matrices indicate the color scale. TADs affected by white gaps involving repetitive regions are highlighted in light green. Light green outlined areas correspond to new TAD boundaries. (C) False discovery rate of TADs detected under two settings. TADs that are not reproducible and lack CTCF peaks at the TAD boundaries are labeled as false positives. (D) Average number of repetitive elements at the boundaries of reproducible TADs compared to those within TADs and genomewide intervals of the same size for GM12878 at 5 kb resolution.

Figure 5—source data 1. Topologically associating domains detected by DomainCaller (Dixon et al., 2012) under Uni&Multi-setting for six replicates of IMR90.

elife-38070-fig5-data1.zip^{(94.5KB, zip)}

DOI: 10.7554/eLife.38070.064

Figure 5—source data 2. Topologically associating domains detected by Arrowhead (Rao et al., 2014) under Uni&Multi-setting for ten replicates of GM12878.

elife-38070-fig5-data2.zip^{(380.2KB, zip)}

DOI: 10.7554/eLife.38070.065

Next, we assessed the abundance of different classes of repetitive elements, from the RepeatMasker (Open R, 2015) and UCSC genome browser (Tyner et al., 2017) hg19 assembly, at the reproducible TAD boundaries. Specifically, we considered segmental duplications (DUP), short interspersed nuclear elements (SINE), long interspersed nuclear elements (LINE), long terminal repeat elements (LTR), DNA transposon (DNA) and satellites (SATE). We utilized ± bin on either side of the edge coordinate of a given domain as its TAD boundary. At a lower resolution, that is 40 kb for IMR90, each boundary is 120 kb region and the percentages of TAD boundaries with each type of repetitive element illustrate negligible differences between the Uni-setting and Uni&Multi-setting (Figure 5—figure supplement 10A). Similarly, due to the large sizes of the TAD boundaries, a majority of TAD boundaries harbor SINE, LINE, LTR, and DNA transposon elements. However, higher resolution analysis of the GM12878 dataset at 5 kb reveals SINE elements as the leading category of elements that co-localizes with more than 99% of TAD boundaries followed by LINEs (Figure 5—figure supplement 10B). This is consistent with the fact that SINE and LINE elements are relatively short and cover a larger portion of the human genome compared to other subfamilies (15% for SINE and 21% for LINE; Treangen and Salzberg, 2012). We further quantified the enrichment of repetitive elements at TAD boundaries by comparing their average abundance with those within TADs and the genomic intervals of the same size across the whole genome as the baseline. Figure 5D and Figure 5—figure supplement 11 show that SINE elements, satellites, and segmental duplications are markedly enriched at the TAD boundaries compared to the whole genome and within TADs. More interestingly, at higher resolution, that is 5 kb for GM12878, the SINE category both have the highest average enrichment and is enhanced by mHi-C (Figure 5D). In summary, under Uni&Multi-setting, the detected TAD boundaries tend to harbor more SINE elements supporting prior work that human genome folding is markedly associated with the SINE family (Cournac et al., 2016).

Large-scale evaluation of mHi-C with computational trimming experiments and simulations establishes its accuracy

Before further investigating the accuracy of mHi-C rescued multi-reads with computational experiments, we considered heuristic strategies for rescuing multi-reads at different stages of the Hi-C analysis pipeline as alternatives to mHi-C (Figure 6A; see Materials and methods for detailed descriptions of the model-free approaches and related analysis). Specifically, AlignerSelect and DistanceSelect rescue multi-reads by simply choosing one of the alignments of a multi-read pair by default aligner strategy and based on distance, respectively. In addition to these, we designed a direct alternative to mHi-C, named SimpleSelect, as a model-free approach that imposes genomic distance priority in contrast to leveraging of the local interaction signals of the bins by mHi-C (e.g., local contact counts due to other read pairs in candidate bin pairs).

Figure 6. — (A) Intuitive heuristic strategies (AlignerSelect, DistanceSelect, SimpleSelect) for model-free assignment of multi-reads at various stages the of Hi-C analysis pipeline. (B) Accuracy of mHi-C in allocating trimmed multi-reads with respect to trimmed read length, compared with model-free approaches as well as random selection as a baseline. (C) Allocation accuracy with respect to mappability for 75 bp reads. Red solid line depicts the overall accuracy trend. ‘Not assigned’ category refers to multi-reads with a maximum posterior probability of assignment $\leq$ 0.5. (D) mHi-C accuracy among different repetitive element classes.

Figure 6—figure supplement 1. — (A) Intuitive heuristic strategies (AlignerSelect, DistanceSelect, SimpleSelect) for model-free assignment of multi-reads at various stages the of Hi-C analysis pipeline. (B) Accuracy of mHi-C in allocating trimmed multi-reads with respect to trimmed read length, compared with model-free approaches as well as random selection as a baseline. (C) Allocation accuracy with respect to mappability for 75 bp reads. Red solid line depicts the overall accuracy trend. ‘Not assigned’ category refers to multi-reads with a maximum posterior probability of assignment $\leq$ 0.5. (D) mHi-C accuracy among different repetitive element classes.

To evaluate the accuracy of mHi-C in a setting with ground truth, we carried out trimming experiments with the A549 151 bp read length dataset and Hi-C data simulations where we compared mHi-C to both a random allocation strategy as the baseline and the additional heuristic approaches we developed (Figure 6A). Specifically, we trimmed the set of 151 bp uni-reads from A549 into read lengths of 36 bp, 50 bp, 75 bp, 100 bp, and 125 bp. As a result, a subset of uni-reads at the full read length of 151 bp with known alignment positions were reduced into multi-reads, generating gold-standard multi-read sets with known true origins. The resulting numbers of valid uni- and multi-reads are summarized in Figure 6—figure supplement 1A in comparison with the numbers of valid uni-reads in the original A549 datasets. The corresponding multi-to-uni ratios of these settings vary with the lengths of the trimmed reads, and their range covers the typical multi-to-uni ratios observed in the full read length datasets (Figure 6—figure supplement 1B).

We first investigated the multi-read allocation accuracy with respect to trimmed read length, sequencing depth, and mappability at resolution 40 kb. Figure 6B exhibits superior performance of mHi-C over both the model-free methods and the random baseline in correctly allocating multi-reads of different lengths to their true origins across intra- and inter-chromosomal contacts. As expected and illustrated by Figure 6B, the accuracy of multi-read assignment has an increasing trend with the read length. Specifically, it ranges between 70% and 90% for mHi-C and 20% and 35% for the random allocation strategy for the shortest and longest trimmed read lengths of 36 bp and 125 bp, respectively. When the allocated multi-reads are stratified as a function of the mappability, reads with the lowest mappability (<0.1) have accuracy levels of less than 32% to 70% across the trimmed read lengths (Figure 6C for 75 bp, Figure 6—figure supplement 2 for the other trimming lengths). Notably, the accuracy quickly reaches 74% to 87% for reads with mappability of at least 0.5 (Figure 6C, Figure 6—figure supplement 2).

Next, we assessed the allocation accuracy among different classes of repetitive elements (Figure 6D). Allocations involving segmental duplication regions exhibit a systematically lower performance compared to other repeat classes and the overall average across the whole genome for all five trimming settings. Notably, even for these segmental duplication regions, the accuracy of mHi-C is markedly higher than both the model-free approaches and the random selection baseline displayed in Figure 6B. To finalize the accuracy investigation, we further varied the trimming setting by mixing uni-reads and multi-reads from different replicates (see setting (ii) of trimming strategies in Materials and methods) and considering resolutions of 10 kb and 40 kb in addition to an empirical Hi-C simulation. Figure 6—figure supplements 3–6 provide accuracy results closely following the results presented in this section from these additional settings and further validate significantly better performance of mHi-C compared to the random allocation and other heuristic approaches across different trimmed read lengths.

After establishing accuracy, we evaluated the impact of mHi-C rescued multi-reads of the trimmed datasets on the recovery of the (original) full read length contact matrices, topological domain structures, and significant interactions. To assess the recovery of the original contact matrix, we compared both the trimmed Uni- and Uni&Multi-settings with the gold standard Uni-setting at the full read length utilizing HiCRep (Yang et al., 2017). Figure 7A and Figure 7—figure supplement 1 illustrate that mHi-C achieves significant improvement in the reproducibility across all chromosomes under all trimming settings compared to the Uni-setting. While the pattern of reproducibility with different read lengths in Figure 7A is consistent with the expectation that the longer trimmed reads should yield contact matrices that are more similar to the full read length one, the improvement in reproducibility due to mHi-C is markedly larger compared to the gains from longer read sequences making multi-read rescue essential. For example, the reproducibility for Uni&Multi-setting at 50 bp is 8.84% to 27.33% higher than that of Uni-setting at 125 bp. We further evaluated reproducibility under each trimming setting across replicates and benchmarked the results against the reproducibility of the Uni-setting with the original read length of 151 bp. Figure 7—figure supplements 2 and 3 confirm the gain in reproducibility across replicates due to Uni&Multi-setting for all the trimming lengths. As expected, the reproducibility across replicates based on the uni-reads of the original read length is higher than the levels achievable by the Uni&Multi-Setting at trimmed read lengths. This comparison further supports that mHi-C assigns multi-reads in a biologically meaningful manner as was evidenced earlier by the increased reproducibility among replicates of the same condition (Figure 2B and Figure 2—figure supplements 9 and 10) but not across replicates of the different conditions (Figure 2—figure supplement 12). It also rules out the possibility of inflation of the reproducibility metric by consistent but biologically irrelevant assignment of multi-reads to certain loci. TAD identification with these trimmed sets highlights the sensitivity of TAD boundary detection to the sequencing depth. Figure 7B and Figure 7—figure supplements 4–7 display examples where the trimmed Uni&Multi-setting achieved better recovery of TAD structure of the full-length dataset compared to trimmed Uni-setting. Overall, this performance is attributable to the accuracy of mHi-C assignments and the resulting increase in sequencing depth of the trimmed uni-read dataset. Finally, we compared the significant interactions detected by the trimmed Uni- and Uni&Multi-settings and observed that mHi-C rescued multi-reads in trimmed datasets enable detection of a larger number of interactions across a range of FDR thresholds (Figure 7—figure supplement 8). Most notably, an evaluation of detection power for the top 10K significant interactions of the full-length dataset demonstrates that, while the Uni-setting can only recover 50% of these at the trimmed read length of 36 bp, Uni&Multi-setting recovers 70% (Figure 7C and Figure 7—figure supplement 9). We note that these power values are slightly underestimated because the full-length uni-read dataset also included chimeric reads that were rescued as uni-reads. In contrast, trimmed reads in the trimming experiments were generated from uni-reads without rescuing chimeric reads (see Materials and methods; Figure 7—figure supplement 10). Despite this, the 26.19% increase in sequencing depth due to multi-reads at the trimmed read length of 36 bp (Figure 6—figure supplement 1B) translated into a significantly better recovery of the significant interactions. Further assessment by ROC and PR analysis (Figure 7D, E and Figure 7—figure supplement 11) of the set of significant contacts identified by both settings illustrates that Uni&Multi-setting exhibits these advantages without inflating the false discoveries. As reads get longer towards the full length, the ROC and PR curves converge under the two settings (Figure 7—figure supplement 11).

Figure 7. — (A) mHi-C rescued multi-reads of the trimmed dataset along with trimmed uni-reads lead to contact matrices that are significantly more similar to original contact matrices compared to only using trimmed uni-reads. (B) TAD detection on chromosome six with the original longer uni-reads contact matrix with black TAD boundaries, trimmed uni-reads (36 bp) contact matrix with green TAD boundaries, and trimmed uni- and multi-reads (36 bp) contact matrix with blue TAD boundaries. (C) The power of recovering top 10,000 significant interactions of full read length dataset using trimmed reads under FDR10%. (**D, E**) Receiver Operating Characteristic (ROC) and Precision-Recall (PR) curves for trimmed Uni- and Uni&Multi-setting. The ground truth for these curves is based on the significant interactions identified by the full read length dataset at FDR of 10%. The dashed line is y = x.

Figure 7—figure supplement 1. — (A) mHi-C rescued multi-reads of the trimmed dataset along with trimmed uni-reads lead to contact matrices that are significantly more similar to original contact matrices compared to only using trimmed uni-reads. (B) TAD detection on chromosome six with the original longer uni-reads contact matrix with black TAD boundaries, trimmed uni-reads (36 bp) contact matrix with green TAD boundaries, and trimmed uni- and multi-reads (36 bp) contact matrix with blue TAD boundaries. (C) The power of recovering top 10,000 significant interactions of full read length dataset using trimmed reads under FDR10%. (**D, E**) Receiver Operating Characteristic (ROC) and Precision-Recall (PR) curves for trimmed Uni- and Uni&Multi-setting. The ground truth for these curves is based on the significant interactions identified by the full read length dataset at FDR of 10%. The dashed line is y = x.

Discussion

Hi-C data are powerful for identifying long-range interacting loci, chromatin loops, topologically associating domains (TADs), and A/B compartments (Lieberman-Aiden et al., 2009; Yu and Ren, 2017). Multi-mapping reads, however, are absent from the typical Hi-C analysis pipelines, resulting in under-representation and under-study of three-dimensional genome organization involving repetitive regions. Consequently, downstream analysis of Hi-C data relies on the incomplete Hi-C contact matrices which have frequent and, sometimes, severe interaction gaps spanning across the whole matrix. While centromeric regions contribute to such gaps, our results indicate that lack of multi-reads in the analysis is a significant contributor. Our Hi-C multi-read mapping strategy, mHi-C, probabilistically allocates high-quality multi-reads to their most likely positions (Figure 1E) and successfully fills in the missing chunks of contact matrices (Figure 2A and Figure 2—figure supplements 1–4). As a result, incorporating multi-reads yields remarkable increase in sequencing depth which is translated into significant and consistent gains in reproducibility of the raw contact counts (Figure 2B) and detected interactions (Figure 2C). Analysis with mHi-C rescued reads identifies novel significant interactions (Figure 3), promoter-enhancer interactions (Figure 4), and refines domain structures (Figure 5). Our computational experiments with trimmed and simulated Hi-C reads validate mHi-C and elucidate the significant impact of multi-reads in all facets of the Hi-C data analysis. We demonstrate that even for the shortest read length of 36 bp, mHi-C accuracy exceeds 74% (85% for longer trimmed reads) for regions with underlying mappability of at least 0.5 (Figure 6C and Figure 6—figure supplement 2). mHiC significantly outperforms a baseline random allocation strategy as well as several other model-free and intuitive multi-read allocation strategies while achieving its worst allocation accuracy of 63% for reads originating from segmental duplications (Figure 6B and D). Trimming experiments further demonstrated the utility of multi-reads for contact matrix, TAD, and significant interaction recovery (Figure 7).

The default setting of mHi-C is intentionally conservative. In this default setting, mHi-C rescues high-quality multi-reads that can be allocated to a candidate alignment position with a high probability of at least 0.5. mHi-C allows relaxation of this strict filtering where instead of keeping reads with allocation probability greater than 0.5, these posterior allocation probabilities can be utilized as fractional contacts. We chose not to pursue this approach in this work as the current downstream analysis pipelines do not accommodate such fractional contacts. Currently, mHi-C model does not take into account potential copy number variations and genome arrangements across the genome. While mHi-C model can be extended to take into account estimated copy number and arrangement maps of the underlying sample genomes as we have done for other multi-read problems (Zhang and Keleş, 2014), our computational experiments with cancerous human alveolar epithelial cells A549 does not reveal any notable deterioration in mHi-C accuracy for these cells with copy number alternations.

Materials and methods

mHi-C workflow

We developed a complete pipeline customized for incorporating high-quality multi-mapping reads into the Hi-C data analysis workflow. The overall pipeline, illustrated in Figure 1—figure supplements 1 and 2, incorporates the essential steps of the Hi-C analysis pipelines. In what follows, we outline the major steps of the analysis to explicitly track multi-reads and describe how mHi-C utilizes them.

Read end alignment: uni- and multi-reads and chimeric reads

The first step in the mHi-C pipeline is the alignment of each read end separately to the reference genome. The default aligner in the mHi-C software is BWA (Li and Durbin, 2010); however mHi-C can work with any aligner that outputs multi-reads. The default alignment parameters are (i) edit distance maximum of 2 including mismatches and gap extension; and (ii) a maximum number of gap open of 1. mHi-C sets the maximum number of alternative hits saved in the XA tag to be 99 to keep track of multi-reads. If the number of alternative alignments exceeds the threshold of 99 in the default setting, these alignments are not recorded in XA tag. We regarded these alignments as low-quality multi-mapping reads compared to those multi-mapping reads that have a relatively smaller number of alternative alignments. In summary, low-quality multi-mapping reads are discarded together with unmapped reads, only leaving uniquely mapping reads and high-quality multi-mapping reads for downstream analysis. mHi-C pipeline further restricts the maximum number of mismatches (maximum to be 2 compared to three in BWA default setting) to ensure that the alignment quality of multi-reads is comparable to that of standard Hi-C pipeline.

Chimeric reads, that span ligation junction of the Hi-C fragments (Figure 1—figure supplement 1) are also a key component of Hi-C analysis pipelines. The ligation junction sequence can be derived from the restriction enzyme recognition sites and used to rescue chimeric reads. mHi-C adapts the pre-splitting strategy of diffHiC (Lun and Smyth, 2015), which is modified from the existing Cutadapt (Martin, 2011) software. Specifically, the read ends are trimmed to the center of the junction sequence. If the trimmed left 5' ends are not too short, for example ≥ 25 bps, these chimeric reads are remapped to the reference genome. As the lengths of the chimeric reads become shorter, these reads tend to become multi-reads.

Valid fragment filtering

While each individual read end is aligned to reference genome separately, inferring interacting loci relies on alignment information of paired-ends. Therefore, read ends are paired after unmapped and singleton read pairs as well as low-quality multi-mapping ends (Figure 1—figure supplement 1 and Supplementary file 1) are discarded. After pairing, read end alignments are further evaluated for their representation of valid ligation fragments that originate from biologically meaningful long-range interactions (Figure 1—figure supplement 1). First, reads that do not originate from around restriction enzyme digestion sites are eliminated since they primarily arise due to random breakage by sonication (Belaghzal et al., 2017). This is typically achieved by filtering the reads based on the total distance of two read end alignments to the restriction site. We required the total distance to be within 50–800 bps for the mammalian datasets and 50–500 bps for P. falciparum. The lower bound of 50 for this parameter is motivated by the chimeric reads with as short as 25 bps on both ends. Second, a single Hi-C interaction ought to involve two restriction fragments. Therefore, read ends falling within the same fragment, either due to dangling end or self-circle ligation, are filtered. Third, because the nature of chromatin folding leads to the abundance of random short-range interactions, interactions between two regions that are too close in the genomic distance are highly likely to be random interaction without regulatory implications. As a result, reads with ends aligning too close to each other are also filtered according to the twice the resolution rule. Notably, as a result of this valid fragment filtering, some multi-mapping reads can be counted as uniquely mapping reads (Supplementary file 1 - 2b). This is because, although a read pair has multiple potential genomic origins dictated by its multiple alignments, only one of them ends up passing the validation screening. Once the multi-mapping uncertainty is eliminated, such read pairs are passed to the downstream analysis as uni-reads. We remark here that standard Hi-C analysis pipelines do not rescue these multi-reads.

Duplicate removal

To remove PCR duplicates, mHi-C considers the following two issues. First, due to allowing a maximum number of 2 mismatches in alignment, some multi-reads may have the exact same alignment position and strand direction with uni-reads. If such duplicates arise, uni-reads are granted higher priority and the overlapping multi-reads together with all their potential alignment positions are discarded completely. This ensures that the uni-reads that arise in standard Hi-C analysis pipelines will not be discarded as PCR duplicates in the mHi-C pipeline. Second, if a multi-mapping read alignment is duplicated with another multi-read, the read with smaller alphabetical read query name will be preserved. More often than not, if multi-read A overlaps multi-read B at a position, then it is highly likely that they will overlap at other positions as well. This convention ensures that it is always the read pair A alignments that are being retained (Figure 1—figure supplement 2).

Genome binning

Due to the typically limited sequencing depths of Hi-C experiments, the reference genome is divided into small non-overlapping intervals, that is bins, to secure enough number of contact counts across units. The unit can be fix-sized genomic intervals or a fixed number of consecutive restriction fragments. mHi-C can switch between the two unit options with ease. After binning, the interaction unit reduces from alignment position pairs to bin pairs. Remarkably, multi-mapping reads, ends of which are located within the same bin pair, reduce to uni-reads as their potential multi-mapping alignment position pairs support the same bin pair contact. Therefore, there is no need to distinguish the candidate alignments within the same bin (Figure 1—figure supplement 2 and Supplementary file 1 - 3b).

mHi-C generative model and parameter estimation

mHi-C infers genomic origins of multi-reads at the bin pair level (Supplementary file 1). We denoted the whole alignment vector for a given paired-end read $i$ by vector $𝐘_{i}$ . If the two read ends of read $i$ align to only bin $j$ and bin $k$ , respectively, we set the respective components of the alignment vector as: $Y_{i, (j, k)}$ = 1 and $Y_{i, (j^{^{'}}, k^{^{'}})} = 0$ , $\forall j^{^{'}} \neq j$ , $k^{^{'}} \neq k$ . Index of read, $i$ , ranges from 1 to $N$ , where $N$ is total number of valid Hi-C reads, including both uni-reads and multi-reads that pass the essential processing in Figure 1—figure supplements 1 and 2. Overall, the reference genome is divided into $M$ bins and $j$ represents the bin index of the end, alignment position of which is upstream compared to the other read end position indicated by $k$ . Namely, $j$ takes on a value from 1 to $M - 1$ and $k$ runs from $j + 1$ to the maximum value $M$ . For uniquely mapping reads, only one alignment is observed, that is $\sum_{(j, k)}^{(M - 1, M)} Y_{i, (j, k)} = 1$ . However, for multi-mapping reads, we have $\sum_{(j, k)}^{(M - 1, M)} Y_{i, (j, k)} > 1$ .

We next defined a hidden variable $Z_{i, (j, k)}$ to denote the true genomic origin of read $i$ . If read $i$ originates from position bin pairs $j$ and $k$ , we have $Z_{i, (j, k)} = 1$ . In addition, a read can only originate from one alignment position pair on the genome; thus, $\sum_{(j, k)}^{(M - 1, M)} Z_{i, (j, k)} = 1$ for both uni- and multi-reads. We define $O_{i}$ = ${$ ( $j$ , $k$ ): $Z_{i, (j, k)}$ = 1 $}$ to represent true genomic origin of read $i$ and $S_{O_{i}}$ as the set of location pairs that read pair $i$ can align to. Hence, $Y_{i, (j, k)}$ = 1, if ( $j$ , $k$ ) $\in S_{O_{i}}$ . Under the assumption that the true alignment can only originate from those observed alignable positions, $O_{i}$ must be one of the location pairs in $S_{O_{i}}$ . We further assume that the indicators of true origin for read $i$ , $𝒁_{𝒊}$ = $(Z_{i, (1, 2)}, Z_{i, (1, 3)}, \dots, Z_{i, (M - 1, M)})$ are random draws from a Dirichlet - Multinomial distribution. Specifically,

Z_{i} \overset{i . i . d .}{\sim} M u l t i n o m i a l (π_{(1, 2)}, π_{(1, 3)}, \dots, π_{(j, k)}, \dots, π_{(M - 1, M)}), i = 1, \dots, N,

(1)

where $π_{(j, k)}$ can be interpreted as contact probability between bin $j$ and $k$ ( $j < k$ ). We further assume that

π \sim D i r i c h l e t (γ_{(1, 2)}, γ_{(1, 3)}, \dots, γ_{(j, k)}, \dots, γ_{(M - 1, M)}),

(2)

where $π = (π_{(1, 2)}, π_{(1, 3)}, \dots, π_{(M - 1, M)})$ and $γ_{(j, k)}$ is a function of genomic distance and quantifies random contact probability. Specifically, we adapt the univariate spline fitting approach from Fit-Hi-C (Ay et al., 2014a) for estimating random contact probabilities with respect to genomic distance and set $γ_{(j, k)} = Spline (j, k) \times N + 1$ . Here, $N$ is the total number of valid reads as defined above and $Spline (j, k)$ denotes the spline estimate of the random contact probability between bins $j$ and $k$ . Therefore, $Spline (j, k) \times N$ is the average random contact counts (i.e., pseudo-counts) between bin $j$ and $k$ . As a result, the probability density function of $π$ can be written as:

\begin{array}{ll} P (π | γ) & = \frac{Γ (\sum_{j = 1}^{M - 1} \sum_{k = j + 1}^{M} γ_{(j, k)})}{\prod_{j = 1}^{M - 1} \prod_{k = j + 1}^{M} Γ (γ_{(j, k)})} \prod_{j = 1}^{M - 1} \prod_{k = j + 1}^{M} π_{(j, k)}^{(γ_{(j, k)} - 1)} \\ = \frac{Γ (\sum_{j = 1}^{M - 1} \sum_{k = j + 1}^{M} (S p l i n e (j, k) \times N + 1))}{\prod_{j = 1}^{M - 1} \prod_{k = j + 1}^{M} Γ (S p l i n e (j, k) \times N + 1)} \prod_{j = 1}^{M - 1} \prod_{k = j + 1}^{M} π_{(j, k)}^{S p l i n e (j, k) \times N} . \end{array}

We next derive the full data joint distribution function.

Lemma 1. Given the true genomic origin under the mHi-C setting, the set of location pairs that a read pair can align to will have observed alignments with probability $1$ .

Proof.

\begin{array}{ll} P (Y_{i} | Z_{i, (j, k)} = 1) & = (Y_{i} | O_{i}) \\ = \prod_{j = 1}^{M - 1} \prod_{k = j + 1}^{M} P (Y_{i, (j, k)} | O_{i}) \\ = \prod_{j = 1}^{M - 1} \prod_{k = j + 1}^{M} [1 (Y_{i, (j, k)} = 1, (j, k) \in S_{O_{i}}) + 1 (Y_{i, (j, k)} \neq 1, (j, k) \notin S_{O_{i}})] \\ = 1. ◻ \end{array}

Based on Lemma 1, we can get the joint distribution $P (𝐘, 𝐙 | π)$ as

\begin{array}{ll} P (Y, Z | π) & = \prod_{i}^{N} P_{π} (Y_{i}, Z_{i}) \\ = \prod_{i}^{N} \prod_{j = 1}^{M - 1} \prod_{k = j + 1}^{M} P_{π} (Y_{i}, Z_{i, (j, k)} = 1)^{Z_{i, (j, k)}} \\ = \prod_{i}^{N} \prod_{j = 1}^{M - 1} \prod_{k = j + 1}^{M} [P_{π} (Y_{i} | Z_{i, (j, k)} = 1) π_{(j, k)}]^{Z_{i, (j, k)}} \\ = \prod_{i}^{N} \prod_{j = 1}^{M - 1} \prod_{k = j + 1}^{M} π_{(j, k)}^{Z_{i, (j, k)}} . \end{array}

Using the Dirichlet-Multinomial conjugacy, we derive the posterior distribution of $π$ as

\begin{array}{ll} P (π | Z) \propto P (π, Z) & = \prod_{i = 1}^{N} P (Z_{i} | π) P (π) \\ \propto \prod_{j = 1}^{M - 1} \prod_{k = j + 1}^{M} π_{(j, k)}^{(\sum_{i = 1}^{N} Z_{i, (j, k)} + γ_{(j, k)} - 1)} \\ = \prod_{j = 1}^{M - 1} \prod_{k = j + 1}^{M} π_{(j, k)}^{(\sum_{i = 1}^{N} Z_{i, (j, k)} + S p l i n e (j, k) \times N)} . \end{array}

We next derive an Expectation-Maximization algorithm for fitting this model.

E-step.

Z_{i, (j, k)}^{(t)} = E (Z_{i, (j, k)} | 𝒀_{𝒊}, 𝝅) = \frac{π_{(j, k)}^{(t)}}{\sum_{(j^{^{'}}, k^{^{'}}) \in S_{O_{i}}} π_{(j^{^{'}}, k^{^{'}})}^{(t)}} 1 [(j, k) \in S_{O_{i}}] .

M-step.

π_{(j, k)}^{(t + 1)} = \frac{\sum_{i = 1}^{N} Z_{i, (j, k)}^{(t)} + S p l i n e (j, k) \times N}{N + \sum_{j^{^{'}} = 1}^{M - 1} \sum_{k^{^{'}} = j + 1}^{M} S p l i n e (j^{^{'}}, k^{^{'}}) \times N} .

Estimate of the contact probability $π_{(j, k)}$ in the M-step can be viewed as an integration of local interaction signal, encoded in $\sum_{i = 1}^{N} Z_{i, (j, k)}^{(t)}$ , and random contact signal due to prior, that is, $Spline (j, k) \times N$ .

The by-products of the EM algorithm are posterior probabilities, P( $Z_{i, (j, k)}$ =1 $| 𝒀_{𝒊}$ $Y_{i}, π$ ), which are utilized for assigning each multi-read to the most likely genomic origin. To keep mHi-C output compatible with the input required for the widely used significant interaction detection methods, we filtered multi-reads with maximum allocation posterior probability less than or equal to 0.5 and assigned the remaining multi-reads to their most likely bin pairs. This ensured the use of at most one bin pair for each multi-read pair. We repeated our computational evaluations by varying this threshold on the posterior probabilities to ensure robustness of the overall conclusions to this threshold.

Assessing false positive rates for significant interactions and TADs identification under the Uni- and Uni&Multi-settings

To quantify false positive rates of the Uni- and Uni&Multi-settings at the significant interaction level, we defined true positives and true negatives by leveraging deeply sequenced replicates of the IMR90 dataset (replicates 1–4). Significant interactions reproducibly identified across all four replicates at 0.1% FDR by both the Uni- and Uni&Multi-settings were labeled as true positives (i.e., true interactions). True negatives were defined as all the interactions that were not deemed significant at 25% FDR in any of the four replicates. We then evaluated significant interactions identified by smaller depth replicates 5 and 6 with ROC and PR curves (Figure 3—figure supplement 13) by using these sets of true positives and negatives as the gold standard. To quantify false positive rates at the topologically associating domains (TADs) level (Figure 5C, Figure 5—figure supplement 2E), we utilized TADs that are reproducible in more than three replicates of the IMR90 dataset and/or harbor CTCF peaks at the boundaries as true positives. The rest of the TADs are supported neither by multiple replicates nor by CTCF, hence are regarded as false positives.

Evaluating reproducibility

Reproducibility in contact matrices was evaluated using HiCRep in the default settings. We further assessed the reproducibility in terms of identified interactions by grouping them into three categories: those only detected under Uni-setting, those unique to Uni&Multi-setting, and those that are detected under both settings. The reproducibility is calculated by overlapping significant interactions between every two replicates and recording the percentage of interactions that are also deemed significant in another replicate (Figure 2—figure supplement 13).

Chromatin states of novel significant interactions

We annotated the novel significant interactions with the 15 states ChromHMM segmentations for IMR90 epigenome (ID E017) from the Roadmap Epigenomics project (Kundaje et al., 2015). All six replicates of IMR90 are merged together in calculating the average enrichment of significant interactions among the 15 states (Figure 3D and Figure 3—figure supplement 14A).

ChIP-seq analysis

ChIP-seq peak sets for IMR90 cells were obtained from ENCODE portal (https://www.encodeproject.org/) and GEO (Barrett et al., 2013). Specifically, we utilized H3K4me1 (ENCSR831JSP), H3K4me3 (ENCSR087PFU), H3K36me3 (ENCSR437ORF), H3K27ac (ENCSR002YRE), H3K27me3 (ENCSR431UUY) and CTCF (ENCSR000EFI) from the ENCODE project and p65 (GSM1055810), p300 (GSM1055812) and PolII (GSM1055822) from GEO (Barrett et al., 2013). In addition, raw data files in fastq format were processed by Permseq (Zeng et al., 2015) utilizing DNase-seq of IMR90 (ENCODE accession ENCSR477RTP) to incorporate multi-reads and, subsequently, peaks were identified using ENCODE uniform ChIP-seq data processing pipeline (https://www.encodeproject.org/pages/pipelines/#DNA-binding). CTCF motif quantification for topologically associating domains was carried out with FIMO (Grant et al., 2011) under the default settings using CTCF motif frequency matrix from JASPAR (Khan et al., 2017).

Promoters with significant interactions

Significant interactions across six replicates of the IMR90 study were annotated with GENCODE V19 (Harrow et al., 2012) gene annotations and enhancer regions from ChromHMM. Gene expression calculations utilized RNA-seq quantification results from the ENCODE project with accession number ENCSR424FAZ.

Marginal Hi-C tracks in Figure 3—figure supplement 15–17

Uni-setting and Uni&Multi-setting Hi-C tracks displayed on the UCSC genome browser figures (Figure 3—figure supplement 15–17) are obtained by aggregating contact counts of six replicates of IMR90 for each genomic coordinate along the genome.

Visualization of contact matrices and interactions

We utilized Juicebox (Durand et al., 2016), HiGlass (Kerpedjiev et al., 2017), and WashU epigenome browser (Zhou et al., 2011) for depicting contact matrices and interactions, respectively, throughout the paper. Normalization of the contact matrices for visualization was carried out by the Knight-Ruiz Matrix Balancing Normalization (Knight and Ruiz, 2013) provided by Juicebox (Durand et al., 2016).

Model-free multi-reads allocation strategies

The simplified and intuitive strategies depicted in Figure 6A correspond to rescuing multi-reads at different essential stages of the Hi-C analysis pipeline. AlignerSelect relies on the base aligner, for example BWA, to determine the primary alignment of each individual end of a multi-read pair. DistanceSelect enables the distance prior to dominate. It selects the read end alignments closest in the genomic distance as the origins of the multi-read pair and defaults to the primary alignment selected by base aligner for inter-chromosomal multi-reads. Finally, SimpleSelect follows the overall mHi-C pipeline closely by making use of the standard Hi-C validation checking and binning procedures. For the reads that align to multiple bins, it selects the bin pair closest in the genomic distance as the allocation of the multi-read pair. Bin-pair allocations for inter-chromosomal multi-reads are set randomly in this strategy.

Comparison of mHi-C with model-free multi-reads allocation for their impact on identifying differential interactions

We evaluated the direct biological consequence of heavily biasing read assignment by genomic distance, as employed by SimpleSelect, by comparing the significant interactions among three life stages of P. falciparum. We reasoned that the better multi-reads allocation strategy would reveal a differential analysis pattern more consistent with the Uni-setting, whereas a genomic distance biased strategy - SimpleSelect - will underestimate differences since multi-reads will be more likely to be allocated to candidate bin pairs with shortest genomic distance regardless of other local contact signals (Figure 6—figure supplement 7A). Figure 6—figure supplement 7B corroborates this drawback of SimpleSelect and demonstrates that mHi-C differential patterns agree better with that of the Uni-setting. Moreover, Figure 6—figure supplement 7B suggests that rings stage is more similar to schizonts, an observation consistent with existing findings on P. falciparum life stages (Ay et al., 2014b; Bunnik et al., 2018).

Trimming procedures

We considered two approaches for generating evaluation datasets where we combined the trimmed multi-reads from replicate two, which has the median sequencing depth among all replicates of the A549 study set, with (i) trimmed reads of replicate two that remain uniquely aligned to the reference genome at the same trimmed read length (Figures 6 and 7), and (ii) uni-reads from other replicates, that is, replicates one, three, and four in the A549 dataset individually (Figure 6—figure supplements 3, 5 and 6). The first setting enables a direct comparison of the set of uni- and multi-reads at trimmed read length compared to uni-reads at the full read length to evaluate accuracy. The numbers of reads are summarized in Figure 6—figure supplement 1A along with multi-to-uni ratios in Figure 6—figure supplement 1B. In the second trimming setting (ii), the uni-read sets are of the original sequencing depth and the added multi-reads constitute a smaller proportion compared to observed levels in the data (Figure 6—figure supplement 1C) due to the chimeric read rescue that was part of full-length datasets (Figure 7—figure supplement 10). Therefore, for this setting, we leverage the higher overall depth of the datasets and evaluate the multi-read assignment accuracy at different resolutions, that is, 10 kb and 40 kb.

Simulation procedures

We devised a simulation strategy that utilizes parameters learned from the Hi-C data and results in data with a similar signal to noise characteristics as the actual data.

Construction of the interaction prior based on the uni-reads fragment interaction frequency list of GM12878 dataset (replicate 6). The frequency list from the prior encompasses both the genomic distance effect and local interaction signal strength and forms the basis for simulating restriction fragment interactions.
Generating the restriction enzyme cutting sites for each simulated fragment pair. After sampling interacting fragments using the frequency list from Step 1, a genomic coordinate within ± bp of the restriction enzyme cutting site and a strand direction are selected randomly. Reads of different lengths (36 bp, 50 bp, 75 bp, 100 bp) are generated starting from these cutting sites.
Mutating the resulting reads. Mutation and gap rates are empirically estimated based on the aligned uni-reads of replicate 6. The reads from Step two are uniformly mutated with these rates allowing up to 2 mutations and one gap.
Simulate sequence quality scores of the reads. We utilize the empirical estimation of the distribution regarding the sequence base quality scores across individual locations of the read length and simulate for each read its sequence quality scores at the nucleotide level.
Alignment to the reference genome. The simulated reads are aligned to the reference genome and filtered for validation as we outline in the mHi-C pipeline, resulting in the set of multi-reads that are utilized by mHi-C.

We generated numbers of multi-reads comparable to those of replicate six. In the final step of the simulation studies, we merged the simulated set of multi-reads with uni-reads of replicates three and six and ran mHi-C step4 (binning) - step5 (prior already available) - step6 (assign multi-reads posterior probability) independently at resolutions 10 kb and 40 kb.

Software availability

mHi-C pipeline is implemented in Python and accelerated by C. The source codes and instructions for running mHi-C are publicly available at https://github.com/keleslab/mHiC (Zheng and Keleş, 2019; copy archived at https://github.com/elifesciences-publications/mHiC). Each step is organized into an independent script with flexible user-defined parameters and implementation options. Therefore, analysis can be carried out from any step of the work-flow and easily fits in high-performance computing environments for parallel computations.

Acknowledgements

This work was supported by NIH HG009744 and NIH HG007019 (SK). FA is partially supported by Institute Leadership Funds from La Jolla Institute for Allergy and Immunology. We thank Peigen Zhou from the University of Wisconsin–Madison for the insightful discussions on accelerating the pipeline. We also thank the peer reviewers and the Reviewing and Senior eLife Editors of this work for their constructive comments.

Funding Statement

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Contributor Information

Sunduz Keles, Email: keles@stat.wisc.edu.

Bing Ren, University of California, San Diego School of Medicine, United States.

Naama Barkai, Weizmann Institute of Science, Israel.

Funding Information

This paper was supported by the following grants:

National Human Genome Research Institute HG009744 to Sunduz Keles.
La Jolla Institute for Allergy and Immunology Institute Leadership Funds to Ferhat Ay.
National Human Genome Research Institute HG007019 to Sunduz Keles.

Additional information

Competing interests

No competing interests declared.

Author contributions

Conceptualization, Resources, Data curation, Software, Formal analysis, Supervision, Funding acquisition, Validation, Investigation, Visualization, Methodology, Writing—original draft, Project administration, Writing—review and editing.

Conceptualization, Resources, Data curation, Software, Investigation, Writing—review and editing.

Additional files

Supplementary file 1. Hi-C and mHi-C terminology.

elife-38070-supp1.pdf^{(631.6KB, pdf)}

DOI: 10.7554/eLife.38070.086

Transparent reporting form

elife-38070-transrepform.docx^{(250.9KB, docx)}

DOI: 10.7554/eLife.38070.087

Data availability

GEO and ENCODE accession codes for all the data analyzed in this manuscript are provided in the manuscript. Source data files have been provided for Figures 1, 3, 4, and 5 (some via Dryad http://dx.doi.org/10.5061/dryad.v7k3140). The mHiC software is made available on github https://github.com/keleslab/mHiC (copy archived at https://github.com/elifesciences-publications/mHiC) with proper documentation.

The following dataset was generated:

Zheng Y, Ay F. 2018. Data from: Generative Modeling of Multi-mapping Reads with mHi-C Advances Analysis of Hi-C Studies. Dryad Digital Repository.

The following previously published datasets were used:

Jin F, Li Y, Dixon JR, Selvaraj S, Ye Z, Lee AY, Yen CA, Schmitt AD, Espinoza C, Ren B. 2013. IMR90 Hi-C Dataset. NCBI Gene Expression Omnibus. GSE43070

Ay F, Bunnik EM, Varoquaux N, Bol SM, Prudhomme J, Vert JP, Noble WS, Le Roch KG. 2014. Plasmodium Hi-C Dataset. NCBI Gene Expression Omnibus. GSE50199

Rao SSP, Huntley MH, Durand NC, Stamenova EK, Bochkov ID, Robinson JT, Sanborn AL, Machol I, Omer AD, Lander ES, Aiden EL A. 2014. GM12878 Hi-C Dataset. NCBI Gene Expression Omnibus. GSE63525

Dixon JR, Selvaraj S, Yue F, Kim A, Li Y, Shen Y, Hu M, Liu JS, Ren B. 2012. ESC(2012) Hi-C Dataset. NCBI Gene Expression Omnibus. GSE35156

Dixon JR, Xu J, Dileep V, Zhan Y, Song F, Le VT, Galip Gurkan Yardımcı AC, Bann DV, Wang Y, Clark R, Zhang L, Yang H, Liu T, Iyyanki S, An L, Pool C, Sasaki T, Rivera-Mulia JC. 2018. A549 Hi-C Dataset. NCBI Gene Expression Omnibus. GSE92819

Bonev B, Cohen NM, Szabo Q. 2017. ESC(2017) & Cortex Hi-C Datasets. NCBI Gene Expression Omnibus. GSE96107

References

Ay F, Bailey TL, Noble WS. Statistical confidence estimation for Hi-C data reveals regulatory chromatin contacts. Genome Research. 2014a;24:999–1011. doi: 10.1101/gr.160374.113. [DOI] [PMC free article] [PubMed] [Google Scholar]
Ay F, Bunnik EM, Varoquaux N, Bol SM, Prudhomme J, Vert JP, Noble WS, Le Roch KG. Three-dimensional modeling of the P. falciparum genome during the erythrocytic cycle reveals a strong connection between genome architecture and gene expression. Genome Research. 2014b;24:974–988. doi: 10.1101/gr.169417.113. [DOI] [PMC free article] [PubMed] [Google Scholar]
Ay F, Noble WS. Analysis methods for studying the 3D architecture of the genome. Genome Biology. 2015;16:183. doi: 10.1186/s13059-015-0745-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
Barrett T, Wilhite SE, Ledoux P, Evangelista C, Kim IF, Tomashevsky M, Marshall KA, Phillippy KH, Sherman PM, Holko M, Yefanov A, Lee H, Zhang N, Robertson CL, Serova N, Davis S, Soboleva A. NCBI GEO: archive for functional genomics data sets—update. Nucleic Acids Research. 2013;41:D991–D995. doi: 10.1093/nar/gks1193. [DOI] [PMC free article] [PubMed] [Google Scholar]
Belaghzal H, Dekker J, Gibcus JH. Hi-C 2.0: an optimized Hi-C procedure for high-resolution genome-wide mapping of chromosome conformation. Methods. 2017;123:56–65. doi: 10.1016/j.ymeth.2017.04.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
Bonev B, Mendelson Cohen N, Szabo Q, Fritsch L, Papadopoulos GL, Lubling Y, Xu X, Lv X, Hugnot JP, Tanay A, Cavalli G. Multiscale 3D genome rewiring during mouse neural development. Cell. 2017;171:557–572. doi: 10.1016/j.cell.2017.09.043. [DOI] [PMC free article] [PubMed] [Google Scholar]
Bunnik EM, Cook KB, Varoquaux N, Batugedara G, Prudhomme J, Cort A, Shi L, Andolina C, Ross LS, Brady D, Fidock DA, Nosten F, Tewari R, Sinnis P, Ay F, Vert JP, Noble WS, Le Roch KG. Changes in genome organization of parasite-specific gene families during the plasmodium transmission stages. Nature Communications. 2018;9 doi: 10.1038/s41467-018-04295-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
Chung D, Kuan PF, Li B, Sanalkumar R, Liang K, Bresnick EH, Dewey C, Keleş S. Discovering transcription factor binding sites in highly repetitive regions of genomes with multi-read analysis of ChIP-Seq data. PLoS Computational Biology. 2011;7:e1002111. doi: 10.1371/journal.pcbi.1002111. [DOI] [PMC free article] [PubMed] [Google Scholar]
Corradin O, Cohen AJ, Luppino JM, Bayles IM, Schumacher FR, Scacheri PC. Modeling disease risk through analysis of physical interactions between genetic variants within chromatin regulatory circuitry. Nature Genetics. 2016;48:1313–1320. doi: 10.1038/ng.3674. [DOI] [PMC free article] [PubMed] [Google Scholar]
Cournac A, Koszul R, Mozziconacci J. The 3D folding of metazoan genomes correlates with the association of similar repetitive elements. Nucleic Acids Research. 2016;44:245–255. doi: 10.1093/nar/gkv1292. [DOI] [PMC free article] [PubMed] [Google Scholar]
de Laat W, Duboule D. Topology of mammalian developmental enhancers and their regulatory landscapes. Nature. 2013;502:499–506. doi: 10.1038/nature12753. [DOI] [PubMed] [Google Scholar]
Dekker J, Rippe K, Dekker M, Kleckner N. Capturing chromosome conformation. Science. 2002;295:1306–1311. doi: 10.1126/science.1067799. [DOI] [PubMed] [Google Scholar]
Dixon JR, Selvaraj S, Yue F, Kim A, Li Y, Shen Y, Hu M, Liu JS, Ren B. Topological domains in mammalian genomes identified by analysis of chromatin interactions. Nature. 2012;485:376–380. doi: 10.1038/nature11082. [DOI] [PMC free article] [PubMed] [Google Scholar]
Dixon JR, Jung I, Selvaraj S, Shen Y, Antosiewicz-Bourget JE, Lee AY, Ye Z, Kim A, Rajagopal N, Xie W, Diao Y, Liang J, Zhao H, Lobanenkov VV, Ecker JR, Thomson JA, Ren B. Chromatin architecture reorganization during stem cell differentiation. Nature. 2015;518:331–336. doi: 10.1038/nature14222. [DOI] [PMC free article] [PubMed] [Google Scholar]
Dixon JR, Xu J, Dileep V, Zhan Y, Song F, Le VT, Yardımcı GG, Chakraborty A, Bann DV, Wang Y, Clark R, Zhang L, Yang H, Liu T, Iyyanki S, An L, Pool C, Sasaki T, Rivera-Mulia JC, Ozadam H, Lajoie BR, Kaul R, Buckley M, Lee K, Diegel M, Pezic D, Ernst C, Hadjur S, Odom DT, Stamatoyannopoulos JA, Broach JR, Hardison RC, Ay F, Noble WS, Dekker J, Gilbert DM, Yue F. Integrative detection and analysis of structural variation in cancer genomes. Nature Genetics. 2018;50:1388–1398. doi: 10.1038/s41588-018-0195-8. [DOI] [PMC free article] [PubMed] [Google Scholar]
Durand NC, Robinson JT, Shamim MS, Machol I, Mesirov JP, Lander ES, Aiden EL. Juicebox provides a visualization system for Hi-C contact maps with unlimited zoom. Cell Systems. 2016;3:99–101. doi: 10.1016/j.cels.2015.07.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
ENCODE Project Consortium An integrated encyclopedia of DNA elements in the human genome. Nature. 2012;489:57–74. doi: 10.1038/nature11247. [DOI] [PMC free article] [PubMed] [Google Scholar]
Ferrari KJ, Scelfo A, Jammula S, Cuomo A, Barozzi I, Stützer A, Fischle W, Bonaldi T, Pasini D. Polycomb-dependent H3K27me1 and H3K27me2 regulate active transcription and enhancer fidelity. Molecular Cell. 2014;53:49–62. doi: 10.1016/j.molcel.2013.10.030. [DOI] [PubMed] [Google Scholar]
Forcato M, Nicoletti C, Pal K, Livi CM, Ferrari F, Bicciato S. Comparison of computational methods for Hi-C data analysis. Nature Methods. 2017;14:679–685. doi: 10.1038/nmeth.4325. [DOI] [PMC free article] [PubMed] [Google Scholar]
Grant CE, Bailey TL, Noble WS. FIMO: scanning for occurrences of a given motif. Bioinformatics. 2011;27:1017–1018. doi: 10.1093/bioinformatics/btr064. [DOI] [PMC free article] [PubMed] [Google Scholar]
Harrow J, Frankish A, Gonzalez JM, Tapanari E, Diekhans M, Kokocinski F, Aken BL, Barrell D, Zadissa A, Searle S, Barnes I, Bignell A, Boychenko V, Hunt T, Kay M, Mukherjee G, Rajan J, Despacio-Reyes G, Saunders G, Steward C, Harte R, Lin M, Howald C, Tanzer A, Derrien T, Chrast J, Walters N, Balasubramanian S, Pei B, Tress M, Rodriguez JM, Ezkurdia I, van Baren J, Brent M, Haussler D, Kellis M, Valencia A, Reymond A, Gerstein M, Guigó R, Hubbard TJ. GENCODE: the reference human genome annotation for the ENCODE project. Genome Research. 2012;22:1760–1774. doi: 10.1101/gr.135350.111. [DOI] [PMC free article] [PubMed] [Google Scholar]
Heinz S, Benner C, Spann N, Bertolino E, Lin YC, Laslo P, Cheng JX, Murre C, Singh H, Glass CK. Simple combinations of lineage-determining transcription factors prime cis-regulatory elements required for macrophage and B cell identities. Molecular Cell. 2010;38:576–589. doi: 10.1016/j.molcel.2010.05.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
Hsu SC, Gilgenast TG, Bartman CR, Edwards CR, Stonestrom AJ, Huang P, Emerson DJ, Evans P, Werner MT, Keller CA, Giardine B, Hardison RC, Raj A, Phillips-Cremins JE, Blobel GA. The BET protein BRD2 cooperates with CTCF to enforce transcriptional and architectural boundaries. Molecular Cell. 2017;66:102–116. doi: 10.1016/j.molcel.2017.02.027. [DOI] [PMC free article] [PubMed] [Google Scholar]
Hwang YC, Lin CF, Valladares O, Malamon J, Kuksa PP, Zheng Q, Gregory BD, Wang LS. HIPPIE: a high-throughput identification pipeline for promoter interacting enhancer elements. Bioinformatics. 2015;31:1290–1292. doi: 10.1093/bioinformatics/btu801. [DOI] [PMC free article] [PubMed] [Google Scholar]
Imakaev M, Fudenberg G, McCord RP, Naumova N, Goloborodko A, Lajoie BR, Dekker J, Mirny LA. Iterative correction of Hi-C data reveals hallmarks of chromosome organization. Nature Methods. 2012;9:999–1003. doi: 10.1038/nmeth.2148. [DOI] [PMC free article] [PubMed] [Google Scholar]
Javierre BM, Burren OS, Wilder SP, Kreuzhuber R, Hill SM, Sewitz S, Cairns J, Wingett SW, Várnai C, Thiecke MJ, Burden F, Farrow S, Cutler AJ, Rehnström K, Downes K, Grassi L, Kostadima M, Freire-Pritchett P, Wang F, Stunnenberg HG, Todd JA, Zerbino DR, Stegle O, Ouwehand WH, Frontini M, Wallace C, Spivakov M, Fraser P, BLUEPRINT Consortium Lineage-Specific genome architecture links enhancers and Non-coding disease variants to target gene promoters. Cell. 2016;167:1369–1384. doi: 10.1016/j.cell.2016.09.037. [DOI] [PMC free article] [PubMed] [Google Scholar]
Jin F, Li Y, Dixon JR, Selvaraj S, Ye Z, Lee AY, Yen CA, Schmitt AD, Espinoza CA, Ren B. A high-resolution map of the three-dimensional chromatin interactome in human cells. Nature. 2013;503:290–294. doi: 10.1038/nature12644. [DOI] [PMC free article] [PubMed] [Google Scholar]
Kerpedjiev P, Abdennur N, Lekschas F, McCallum C, Dinkla K, Strobelt H, Luber JM, Ouellette SB, Ahzir A, Kumar N. HiGlass: web-based visual comparison and exploration of genome interaction maps. Genome Biology . 2017 doi: 10.1186/s13059-018-1486-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
Khan A, Fornes O, Stigliani A, Gheorghe M, Castro-Mondragon JA, van der Lee R, Bessy A, Chèneby J, Kulkarni SR, Tan G. JASPAR 2018: update of the open-access database of transcription factor binding profiles and its web framework. Nucleic Acids Research. 2017 doi: 10.1093/nar/gkx1126. [DOI] [PMC free article] [PubMed] [Google Scholar]
Knight PA, Ruiz D. A fast algorithm for matrix balancing. IMA Journal of Numerical Analysis. 2013;33:1029–1047. doi: 10.1093/imanum/drs019. [DOI] [Google Scholar]
Kundaje A, Meuleman W, Ernst J, Bilenky M, Yen A, Heravi-Moussavi A, Kheradpour P, Zhang Z, Wang J, Ziller MJ, Amin V, Whitaker JW, Schultz MD, Ward LD, Sarkar A, Quon G, Sandstrom RS, Eaton ML, Wu YC, Pfenning AR, Wang X, Claussnitzer M, Liu Y, Coarfa C, Harris RA, Shoresh N, Epstein CB, Gjoneska E, Leung D, Xie W, Hawkins RD, Lister R, Hong C, Gascard P, Mungall AJ, Moore R, Chuah E, Tam A, Canfield TK, Hansen RS, Kaul R, Sabo PJ, Bansal MS, Carles A, Dixon JR, Farh KH, Feizi S, Karlic R, Kim AR, Kulkarni A, Li D, Lowdon R, Elliott G, Mercer TR, Neph SJ, Onuchic V, Polak P, Rajagopal N, Ray P, Sallari RC, Siebenthall KT, Sinnott-Armstrong NA, Stevens M, Thurman RE, Wu J, Zhang B, Zhou X, Beaudet AE, Boyer LA, De Jager PL, Farnham PJ, Fisher SJ, Haussler D, Jones SJ, Li W, Marra MA, McManus MT, Sunyaev S, Thomson JA, Tlsty TD, Tsai LH, Wang W, Waterland RA, Zhang MQ, Chadwick LH, Bernstein BE, Costello JF, Ecker JR, Hirst M, Meissner A, Milosavljevic A, Ren B, Stamatoyannopoulos JA, Wang T, Kellis M, Roadmap Epigenomics Consortium Integrative analysis of 111 reference human epigenomes. Nature. 2015;518:317–330. doi: 10.1038/nature14248. [DOI] [PMC free article] [PubMed] [Google Scholar]
Li B, Dewey CN. RSEM: accurate transcript quantification from RNA-Seq data with or without a reference genome. BMC Bioinformatics. 2011;12:323. doi: 10.1186/1471-2105-12-323. [DOI] [PMC free article] [PubMed] [Google Scholar]
Li H, Durbin R. Fast and accurate long-read alignment with Burrows-Wheeler transform. Bioinformatics. 2010;26:589–595. doi: 10.1093/bioinformatics/btp698. [DOI] [PMC free article] [PubMed] [Google Scholar]
Lieberman-Aiden E, van Berkum NL, Williams L, Imakaev M, Ragoczy T, Telling A, Amit I, Lajoie BR, Sabo PJ, Dorschner MO, Sandstrom R, Bernstein B, Bender MA, Groudine M, Gnirke A, Stamatoyannopoulos J, Mirny LA, Lander ES, Dekker J. Comprehensive mapping of long-range interactions reveals folding principles of the human genome. Science. 2009;326:289–293. doi: 10.1126/science.1181369. [DOI] [PMC free article] [PubMed] [Google Scholar]
Lun AT, Smyth GK. diffHic: a bioconductor package to detect differential genomic interactions in Hi-C data. BMC Bioinformatics. 2015;16:258. doi: 10.1186/s12859-015-0683-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
Martin M. Cutadapt removes adapter sequences from high-throughput sequencing reads. EMBnet.journal. 2011;17:10. doi: 10.14806/ej.17.1.200. [DOI] [Google Scholar]
Mifsud B, Tavares-Cadete F, Young AN, Sugar R, Schoenfelder S, Ferreira L, Wingett SW, Andrews S, Grey W, Ewels PA, Herman B, Happe S, Higgs A, LeProust E, Follows GA, Fraser P, Luscombe NM, Osborne CS. Mapping long-range promoter contacts in human cells with high-resolution capture Hi-C. Nature Genetics. 2015;47:598–606. doi: 10.1038/ng.3286. [DOI] [PubMed] [Google Scholar]
Ong CT, Corces VG. CTCF: an architectural protein bridging genome topology and function. Nature Reviews Genetics. 2014;15:234–246. doi: 10.1038/nrg3663. [DOI] [PMC free article] [PubMed] [Google Scholar]
Open R RepeatMasker. 4.02015 https://www.repeatmasker.org
Pombo A, Dillon N. Three-dimensional genome architecture: players and mechanisms. Nature Reviews Molecular Cell Biology. 2015;16:245–257. doi: 10.1038/nrm3965. [DOI] [PubMed] [Google Scholar]
Rao SS, Huntley MH, Durand NC, Stamenova EK, Bochkov ID, Robinson JT, Sanborn AL, Machol I, Omer AD, Lander ES, Aiden EL. A 3D map of the human genome at Kilobase resolution reveals principles of chromatin looping. Cell. 2014;159:1665–1680. doi: 10.1016/j.cell.2014.11.021. [DOI] [PMC free article] [PubMed] [Google Scholar]
Rosa-Garrido M, Chapski DJ, Schmitt AD, Kimball TH, Karbassi E, Monte E, Balderas E, Pellegrini M, Shih TT, Soehalim E, Liem D, Ping P, Galjart NJ, Ren S, Wang Y, Ren B, Vondriska TM. High-Resolution mapping of chromatin conformation in cardiac myocytes reveals structural remodeling of the epigenome in heart failure. Circulation. 2017;136:1613–1625. doi: 10.1161/CIRCULATIONAHA.117.029430. [DOI] [PMC free article] [PubMed] [Google Scholar]
Safran M, Dalah I, Alexander J, Rosen N, Iny Stein T, Shmoish M, Nativ N, Bahir I, Doniger T, Krug H, Sirota-Madi A, Olender T, Golan Y, Stelzer G, Harel A, Lancet D. GeneCards version 3: the human gene integrator. Database. 2010;2010:baq020. doi: 10.1093/database/baq020. [DOI] [PMC free article] [PubMed] [Google Scholar]
Servant N, Varoquaux N, Lajoie BR, Viara E, Chen CJ, Vert JP, Heard E, Dekker J, Barillot E. HiC-Pro: an optimized and flexible pipeline for Hi-C data processing. Genome Biology. 2015;16:259. doi: 10.1186/s13059-015-0831-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
Spielmann M, Lupiáñez DG, Mundlos S. Structural variation in the 3D genome. Nature Reviews Genetics. 2018;19:453–467. doi: 10.1038/s41576-018-0007-0. [DOI] [PubMed] [Google Scholar]
Sun JH, Zhou L, Emerson DJ, Phyo SA, Titus KR, Gong W, Gilgenast TG, Beagan JA, Davidson BL, Tassone F, Phillips-Cremins JE. Disease-Associated short tandem repeats Co-localize with chromatin domain boundaries. Cell. 2018;175:224–238. doi: 10.1016/j.cell.2018.08.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
Tang Z, Luo OJ, Li X, Zheng M, Zhu JJ, Szalaj P, Trzaskoma P, Magalska A, Wlodarczyk J, Ruszczycki B, Michalski P, Piecuch E, Wang P, Wang D, Tian SZ, Penrad-Mobayed M, Sachs LM, Ruan X, Wei CL, Liu ET, Wilczynski GM, Plewczynski D, Li G, Ruan Y. CTCF-Mediated human 3D genome architecture reveals chromatin topology for transcription. Cell. 2015;163:1611–1627. doi: 10.1016/j.cell.2015.11.024. [DOI] [PMC free article] [PubMed] [Google Scholar]
Treangen TJ, Salzberg SL. Repetitive DNA and next-generation sequencing: computational challenges and solutions. Nature Reviews Genetics. 2012;13:36–46. doi: 10.1038/nrg3117. [DOI] [PMC free article] [PubMed] [Google Scholar]
Tyner C, Barber GP, Casper J, Clawson H, Diekhans M, Eisenhart C, Fischer CM, Gibson D, Gonzalez JN, Guruvadoo L, Haeussler M, Heitner S, Hinrichs AS, Karolchik D, Lee BT, Lee CM, Nejad P, Raney BJ, Rosenbloom KR, Speir ML, Villarreal C, Vivian J, Zweig AS, Haussler D, Kuhn RM, Kent WJ. The ucsc genome browser database: 2018 update. Nucleic Acids Research. 2017;45 doi: 10.1093/nar/gkw1134. [DOI] [PMC free article] [PubMed] [Google Scholar]
Won H, de la Torre-Ubieta L, Stein JL, Parikshak NN, Huang J, Opland CK, Gandal MJ, Sutton GJ, Hormozdiari F, Lu D, Lee C, Eskin E, Voineagu I, Ernst J, Geschwind DH. Chromosome conformation elucidates regulatory relationships in developing human brain. Nature. 2016;538:523–527. doi: 10.1038/nature19847. [DOI] [PMC free article] [PubMed] [Google Scholar]
Xie M, Hong C, Zhang B, Lowdon RF, Xing X, Li D, Zhou X, Lee HJ, Maire CL, Ligon KL, Gascard P, Sigaroudinia M, Tlsty TD, Kadlecek T, Weiss A, O'Geen H, Farnham PJ, Madden PA, Mungall AJ, Tam A, Kamoh B, Cho S, Moore R, Hirst M, Marra MA, Costello JF, Wang T. DNA hypomethylation within specific transposable element families associates with tissue-specific enhancer landscape. Nature Genetics. 2013;45:836–841. doi: 10.1038/ng.2649. [DOI] [PMC free article] [PubMed] [Google Scholar]
Yang T, Zhang F, Yardımcı GG, Song F, Hardison RC, Noble WS, Yue F, Li Q. HiCRep: assessing the reproducibility of Hi-C data using a stratum-adjusted correlation coefficient. Genome Research. 2017;27:1939–1949. doi: 10.1101/gr.220640.117. [DOI] [PMC free article] [PubMed] [Google Scholar]
Yardımcı G, Özadam H, Sauria ME, Ursu O, Yan K-K, Yang T, Chakraborty A, Kaul A, Lajoie BR, Song F. Measuring the reproducibility and quality of Hi-C data. bioRxiv. 2017 doi: 10.1101/188755. [DOI] [PMC free article] [PubMed]
Yu M, Ren B. The Three-Dimensional organization of mammalian genomes. Annual Review of Cell and Developmental Biology. 2017;33:265–289. doi: 10.1146/annurev-cellbio-100616-060531. [DOI] [PMC free article] [PubMed] [Google Scholar]
Zeng X, Li B, Welch R, Rojo C, Zheng Y, Dewey CN, Keleş S. Perm-seq: mapping Protein-DNA interactions in segmental duplication and highly repetitive regions of genomes with Prior-Enhanced read mapping. PLOS Computational Biology. 2015;11:e1004491. doi: 10.1371/journal.pcbi.1004491. [DOI] [PMC free article] [PubMed] [Google Scholar]
Zhang Q, Keleş S. CNV-guided multi-read allocation for ChIP-seq. Bioinformatics. 2014;30:2860–2867. doi: 10.1093/bioinformatics/btu402. [DOI] [PMC free article] [PubMed] [Google Scholar]
Zhang Z, Xing Y. CLIP-seq analysis of multi-mapped reads discovers novel functional RNA regulatory sites in the human transcriptome. Nucleic Acids Research. 2017;45:9260–9271. doi: 10.1093/nar/gkx646. [DOI] [PMC free article] [PubMed] [Google Scholar]
Zheng Y, Keleş S. GitHub; 2019. https://github.com/keleslab/mHiC [Google Scholar]
Zhou X, Maricque B, Xie M, Li D, Sundaram V, Martin EA, Koebbe BC, Nielsen C, Hirst M, Farnham P, Kuhn RM, Zhu J, Smirnov I, Kent WJ, Haussler D, Madden PA, Costello JF, Wang T. The human epigenome browser at Washington university. Nature Methods. 2011;8:989–990. doi: 10.1038/nmeth.1772. [DOI] [PMC free article] [PubMed] [Google Scholar]

eLife. doi: 10.7554/eLife.38070.102

Decision letter

Editor: Bing Ren¹

Reviewed by: Mikhail Spivakov²

In the interests of transparency, eLife includes the editorial decision letter and accompanying author responses. A lightly edited version of the letter sent to the authors after peer review is shown, indicating the most substantive concerns; minor comments are not usually included.

Thank you for submitting your article "Statistical Methods for Profiling 3-Dimensional Chromatin Interactions from Repetitive Regions of Genomes" for consideration by eLife. Your article has been reviewed by three peer reviewers, and the evaluation has been overseen by a Reviewing Editor and a Senior Editor. The following individual involved in review of your submission has agreed to reveal his identity: Mikhail Spivakov (Reviewer #1).

The reviewers have discussed the reviews with one another and the Reviewing Editor has drafted this decision to help you prepare a revised submission.

Summary:

Zheng et al. describe a new approach and associated software tool (mHi-C) that attempts to rescue multi-mappers from Hi-C data. Multi-mappers are normally discarded in most analysis pipelines, but including them may help improve analysis results, particularly at and near repetitive regions of the genome. mHi-C uses a probabilistic model to assign likely multi-read alignment locations based on the expected properties of Hi-C read-pairs, including their average interaction profile as a function of distance between regions along the genome. The authors evaluate the impact mHi-C has on a variety of Hi-C analysis results, including the identification of significant contacts, analysis reproducibility, and TAD boundary identification, ultimately concluding that mHi-C identifies additional chromatin interaction features and generally improves the accuracy and interpretation of Hi-C data.

This work is very timely as there are few (if any) suitable methods available that address multi-mapping reads from Hi-C experiments. mHi-C has the potential to make Hi-C data analysis more complete by avoiding discarding data and could potentially enable the analysis of how repetitive regions interact in the nucleus, which until this point has been largely ignored.

While the authors' approach appears reasonable, the main limitation of the manuscript is that the improvement in Hi-C analysis enabled by using mHi-C to re-interpret multi-mappers is difficult to judge, even for someone with experience looking at Hi-C data. More specifically, the primary concern is that the analysis lacks a gold standard and negative control datasets to properly interpret the reported improvement in Hi-C analysis afforded by mHi-C.

Essential revisions:

1) In an effort to improve the interpretation of mHi-C's impact on Hi-C analysis results, the authors should take a different approach for the evaluation of their method that would improve the manuscript. For example:

- It would be good to have a clearer idea of the method's accuracy at different ranges of read mappability – ideally, on simulated data derived using methods such as Sim3C (https://doi.org/10.1093/gigascience/gix103).

- The authors use a single mammalian dataset for validation, but it would be useful to evaluate its accuracy and gain in interaction detection power for a range of mammalian datasets of different quality (as assessed, for example, by cis/trans-ratios) and coverage, generated by different labs.

- Take a set of publicly available long read Hi-C experiments and artificially truncate the sequencing reads to create a gold-standard data set that could be used to evaluate how well mHi-C "recovers" the true alignment positions using the truncated reads. The truncated data, the original data, and the inferred mHi-C analysis of the truncated data could then be compared to evaluate how accurately mHi-C recovered the original read alignment positions, and then the improvement of Hi-C analysis metrics could be compared to see how mHi-C does compared to the true positive result of comparing the original read alignments vs. the truncated set. This would provide the needed context to evaluate how these metrics and analysis scores should be interpreted with respect to a true positive. It would be even better to include a negative control for comparison based on the random assignment of multi-mapper positions using a uniform prior (i.e. randomly take one of the valid read-pair alignments without considering distance etc.).

With these datasets you can estimate how much better the TADs should look if multi-mapper assignment was perfect, and how many more significant interactions there should be, etc., by comparing the true positive data to the truncated data. This analysis has the added benefit of enabling a direct calculation of mHi-C assignment accuracy and could identify which types of multi-mappers are more problematic, and may provide evidence of which repetitive features (i.e. LINE/SINE/segmental duplications/centromeres/etc.) are easy or hard to assign multi-mappers to.

2) Comparison with normalized Hi-C matrix: the authors need to compare their results with either ICE normalized or model-based method normalized Hi-C matrix. As mappability is one of the most important factors during normalization procedure, the results of comparison can be valuable to demonstrate the significance of this work.

3) Figure 5: it would be much more convincing if the authors can further zoom in, and clearly show a few examples where a specific enhancer-promoter interaction is captured only by mHi-C? Maybe virtual 4C is the best way for this purpose.

4) What is the purpose of Figure 3? Why is there a need to introduce an alternative approach to mHi-C model and make it into a main figure?

5) The title suggests that the authors will explore the chromatin interactions from repetitive regions. However, not much analysis was provided on this perspective. It would be really interesting if the authors could delve into this topic. For example, whether certain repetitive elements or sub-class of repetitive elements are involved with the formation of chromatin looping or TADs.

[Editors' note: further revisions were requested prior to acceptance, as described below.]

Thank you for resubmitting your work entitled "Generative Modeling of Multi-mapping Reads with mHi-C Advances Analysis of Hi-C Studies" for further consideration at eLife. Your revised article has been favorably evaluated by a Senior Editor, a Reviewing Editor, and three reviewers.

The manuscript has been improved but there are some remaining issues that need to be addressed before acceptance, as outlined below:

One primary concern is "why including multi-mappers would increase the reproducibility of Hi-C contact maps." This might be related to how the concept of 'reproducibility' (Figure 2 and other panels, subsection “Probabilistic assignment of multi-reads results in more complete contact matrices and significantly improves reproducibility across replicates”) is defined. It would be important to clearly establish how the improvement in reproducibility by multi-mapper is not a consequence of artifacts. There are other concerns with the TAD analysis, and unsatisfactory responses to two issues raised by one reviewer (#3).

Reviewer #1:

I am happy with the changes made and recommend accepting the paper for publication.

Reviewer #2:

The authors have considerably improved the manuscript, implementing many of the suggestions from the previous review and refining their results.

Concerns on the revision:

The primary concern in the revision is how the authors discuss the concept of 'reproducibility' (Figure 2 and other panels, subsection “Probabilistic assignment of multi-reads results in more complete contact matrices and significantly improves reproducibility across replicates”). Specifically, it is not clear conceptually why including multi-mappers would increase the reproducibility of Hi-C contact maps. It is clear that proper inclusion of multi-mappers should increase the completeness of the data, but since there is still a decent chance of mis-assignment when assigning multi-mappers (~25% based on Figure 6B), it's hard to understand how the 'reproducibility' should increase with the inclusion of multi-mappers. One would expect the uni-mappers to be the most 'reproducible' part of the data since they can be accurately placed, so adding data with 'less reproducible' mapping rates to the experiment should, if anything, reduce the actual reproducibility.

One (likely) explanation for this is that mHi-C assigns multi-mappers 'reproducibly' to the same loci across multiple experiments (even if these assignments are not appropriate), which might give the illusion of higher reproducibility. An important control for this is to compare the computationally trimmed dataset reproducibility to the original uni-read reproducibility, which is unfortunately omitted in Figure 7A, which only compares trimmed uni-mappers to trimmed uni+multi mappers. If the original uni-reads are in fact less reproducible than the trimmed-uniq+multi mapper experiments, there is a very good chance the reproducibility metric is being inflated by consistent assignment of multimappers to certain loci by mHi-C. This is not necessarily a major problem with the method (since the authors demonstrate nicely that mHi-C provides many benefits for Hi-C analysis), but it is a major problem with the interpretation of mHi-C's benefits with respect to reproducibility, which is stated many times throughout the manuscript.

The TAD analysis is still not very convincing (Figure 7B). The contact matrices look really similar between all conditions, but the called TADs for the Trimmed Uni-reads looks different for some reason. For example, the big TAD on the upper left doesn't seem to adhere to the likely TAD in the contact map. This may be a quirk of the TAD identification algorithm, but it doesn't make for a convincing visual case. The contact map intensity for many of the figures is getting clipped at local interactions (i.e. the region near the diagonal is essentially the same color of red), making it hard to see where the key differences are that drive the difference in the TAD calling. I would highly recommend either zooming in on smaller regions and/or changing the color scheme/scaling so that the TAD calls and the contact map can be more clearly evaluated by the reader.

Reviewer #3:

The authors have addressed most of my concerns. Two questions remain:

1) Figure 4A: I am confused. First of all, the second track shouldn't be there – that's the whole chromosome. I think what the authors intended to plotted is the region in the tiny blue box. Second comment about this figure: if you look at the first track (virtual 4C), in the middle, there is a strong Uni&Multi peak, but when you look at the bottom two tracks (arcs), it shows it is uni-specific interaction. Can author clarify what happened?

2) Regarding this response about its performance on normalized Hi-C matrix, the authors commented that "We updated all the visualizations to display both the normalized and unnormalized versions (Figure 2A, Figure 2—f – —figure supplements 1-4). While the normalized Uni-setting matrices look less incomplete highlighting the impact of normalization, mHi-C generated matrices look visually more complete and display the impact of multi-reads. We provided several such examples as supplementary figures."

I found the answer is not satisfactory – the authors need to provide quantitative evaluation of this claim.

eLife. 2019 Jan 31;8:e38070. doi: 10.7554/eLife.38070.103

Author response

Essential revisions:

1) In an effort to improve the interpretation of mHi-C's impact on Hi-C analysis results, the authors should take a different approach for the evaluation of their method that would improve the manuscript. For example:

- It would be good to have a clearer idea of the method's accuracy at different ranges of read mappability – ideally, on simulated data derived using methods such as Sim3C (https://doi.org/10.1093/gigascience/gix103).

We have addressed this point both with trimming experiments where we trim long read datasets to generate shorter read sets and also with simulations where we simulate Hi-C multi-reads. The results displayed in Figures 6B, C and Figure 6—figure supplements 2-5 demonstrate mHi-C’s accuracy in finding correct assignments for multi reads.

These results are incorporated into the subsection “Large-scale evaluation of mHi-C with computational trimming experiments and simulations establishes its accuracy” as follows:

“We first investigated the multi-read allocation accuracy with respect to trimmed read length, sequencing depth, and mappability at resolution 40 kb. […] Figure 6—figure supplements 3-6 provide accuracy results closely following the results presented in this section from these additional settings and further validate significantly better performance of mHi-C compared to the random allocation and other heuristic approaches across different trimmed read lengths.”

- The authors use a single mammalian dataset for validation, but it would be useful to evaluate its accuracy and gain in interaction detection power for a range of mammalian datasets of different quality (as assessed, for example, by cis/trans-ratios) and coverage, generated by different labs.

We have now included 8 datasets from 6 different studies, totaling 4 human, 3 mice, and a Plasmodium falciparum dataset with varying characteristics and showed that our main conclusions are consistent across the board. The results pertaining abundance of multi-reads (Figure 1B, D and Figure 1—figure supplements 3-6), their impact on reproducibility (Figure 2B, C and Figure 2—figure supplements 6-9), and gain in power (Figure 3A, B and Figure 3—figure supplements 1-7) are updated with results across all datasets. We further utilized IMR90 and GM12878 datasets along with long read A459 dataset for more detailed analysis, trimming experiments, and simulations. Discussion on the datasets selected is included into the subsection “Multi-reads significantly increase the sequencing depths of Hi-C data” as follows:

“For developing mHi-C and studying its operating characteristics, we utilized six published studies, resulting in eight datasets with multiple replicates, as summarized in Table 1 with more details in Figure 1—source data 1: Table 1. […] Specifically, they span a wide range of sequencing depths (Figure 1B), coverages and cis-to-trans ratios (Figure 1—figure supplement 3), and have different proportions of mappable and valid reads (Figure 1—figure supplement 4).”

- Take a set of publicly available long read Hi-C experiments and artificially truncate the sequencing reads to create a gold-standard data set that could be used to evaluate how well mHi-C "recovers" the true alignment positions using the truncated reads. The truncated data, the original data, and the inferred mHi-C analysis of the truncated data could then be compared to evaluate how accurately mHi-C recovered the original read alignment positions, and then the improvement of Hi-C analysis metrics could be compared to see how mHi-C does compared to the true positive result of comparing the original read alignments vs. the truncated set. This would provide the needed context to evaluate how these metrics and analysis scores should be interpreted with respect to a true positive. It would be even better to include a negative control for comparison based on the random assignment of multi-mapper positions using a uniform prior (i.e. randomly take one of the valid read-pair alignments without considering distance etc.).

With these datasets you can estimate how much better the TADs should look if multi-mapper assignment was perfect, and how many more significant interactions there should be, etc., by comparing the true positive data to the truncated data. This analysis has the added benefit of enabling a direct calculation of mHi-C assignment accuracy and could identify which types of multi-mappers are more problematic, and may provide evidence of which repetitive features (i.e. LINE/SINE/segmental duplications/centromeres/etc.) are easy or hard to assign multi-mappers to.

We would like to thank the reviewers for these excellent suggestions. We carried out the trimming experiment utilizing the long read (151bp) A549 dataset. Specifically, we leveraged this dataset to evaluate mHi-C in terms of:

i) multi-read allocation accuracy, both overall and stratified with respect to read length, mappability, and repetitive elements. Such accuracy is compared with model-free approaches as well as random selection as a baseline. (Figure 6 and Figure 6—figure supplements 2-6);

ii) the ability to recover contact matrix of the full read length dataset that the trimming is based on (Figure 7A, Figure 7—figure supplement 1), ability to recover TAD calls of the full read length dataset (Figure 7B, Figure 7—figure supplements 2-5) and ability to detect significant interactions that can be detected by the full read length dataset (Figure 7C-E and Figure 7—figure supplements 6-8).

The subsection “Large-scale evaluation of mHi-C with computational trimming experiments and simulations establishes its accuracy” is largely dedicated to the results from these trimming experiments.

2) Comparison with normalized Hi-C matrix: the authors need to compare their results with either ICE normalized or model-based method normalized Hi-C matrix. As mappability is one of the most important factors during normalization procedure, the results of comparison can be valuable to demonstrate the significance of this work.

We updated all the visualizations to display both the normalized and unnormalized versions (Figure 2A, Figure 2—figure supplements 1-4). While the normalized Uni-setting matrices look less incomplete highlighting the impact of normalization, mHi-C generated matrices look visually more complete and display the impact of multi-reads. We provided several such examples as supplementary figures.

3) Figure 5: it would be much more convincing if the authors can further zoom in, and clearly show a few examples where a specific enhancer-promoter interaction is captured only by mHi-C? Maybe virtual 4C is the best way for this purpose.

Figure 4A and Figure 4—figure supplements 1-2 now provide higher resolution examples of reproducibly detected novel promoter-enhancer interactions with a 4C like display.

4) What is the purpose of Figure 3? Why is there a need to introduce an alternative approach to mHi-C model and make it into a main figure?

Great question! When we discuss multi-reads in various research communities, everyone seems to come up with various suggestions that have not been applied or implemented yet. Nonetheless, we wanted to summarize the reasonable, albeit heuristic, approaches of allocating multi-reads and compare these with mHi-C. We have now included this figure as supplement (Figure 6—figure supplement 7) and reorganized the related analysis in the subsection “Comparison of mHi-C with model-free multi-reads allocation for their impact on identifying differential interactions”. More importantly, we were able to evaluate these heuristic approaches along with a baseline method of randomly selecting one of the alignments in our trimming experiments and simulations (Figure 6 and Figure 6—figure supplements 3, 4).

5) The title suggests that the authors will explore the chromatin interactions from repetitive regions. However, not much analysis was provided on this perspective. It would be really interesting if the authors could delve into this topic. For example, whether certain repetitive elements or sub-class of repetitive elements are involved with the formation of chromatin looping or TADs.

We completely agree that delving more into this topic would be very interesting. For this manuscript, we evaluated the abundance of repetitive elements at TAD boundaries. This analysis indicated that at lower resolutions (e.g., 40 kb bin size), there are not significant differences in the abundance of repetitive elements under the Uni and Uni&Multi-settings. However, the analysis of GM12878 datasets at the 5 kb resolution clearly illustrates enrichment of the SINE elements, segmental duplications, and satellite repeats at the TAD boundaries compared to within boundaries and intervals of the same size genome-wide intervals (Figure 5D). More interestingly, the SINE category both has the highest average enrichment and is enhanced by mHi-C (Figure 5—figure supplement 11B).

This analysis is now incorporated into the subsection “Multi-reads refine the boundaries of topologically associating domains” as follows.

“Next, we assessed the abundance of different classes of repetitive elements, from the RepeatMasker (Open, 2015) and UCSC genome browser (Casper et al., 2017) hg19 assembly, at the reproducible TAD boundaries. […] In summary, under Uni&Multi-setting, the detected TAD boundaries tend to harbor more SINE elements supporting prior work that human genome folding is markedly associated with the SINE family Cournac et al. (2015).”

We also thought that the title “Generative Modeling of Multi-mapping Reads with mHi-C Advances Analysis of High Throughput Genome-wide Conformation Capture Studies” is now more reflective of the research presented in this paper.

[Editors' note: further revisions were requested prior to acceptance, as described below.]

Reviewer #2:

The authors have considerably improved the manuscript, implementing many of the suggestions from the previous review and refining their results.

Concerns on the revision:

The primary concern in the revision is how the authors discuss the concept of 'reproducibility' (Figure 2 and other panels, subsection “Probabilistic assignment of multi-reads results in more complete contact matrices and significantly improves reproducibility across replicates”). Specifically, it is not clear conceptually why including multi-mappers would increase the reproducibility of Hi-C contact maps. It is clear that proper inclusion of multi-mappers should increase the completeness of the data, but since there is still a decent chance of mis-assignment when assigning multi-mappers (~25% based on Figure 6B), it's hard to understand how the 'reproducibility' should increase with the inclusion of multi-mappers. One would expect the uni-mappers to be the most 'reproducible' part of the data since they can be accurately placed, so adding data with 'less reproducible' mapping rates to the experiment should, if anything, reduce the actual reproducibility.

One (likely) explanation for this is that mHi-C assigns multi-mappers 'reproducibly' to the same loci across multiple experiments (even if these assignments are not appropriate), which might give the illusion of higher reproducibility. An important control for this is to compare the computationally trimmed dataset reproducibility to the original uni-read reproducibility, which is unfortunately omitted in Figure 7A, which only compares trimmed uni-mappers to trimmed uni+multi mappers. If the original uni-reads are in fact less reproducible than the trimmed-uniq+multi mapper experiments, there is a very good chance the reproducibility metric is being inflated by consistent assignment of multimappers to certain loci by mHi-C. This is not necessarily a major problem with the method (since the authors demonstrate nicely that mHi-C provides many benefits for Hi-C analysis), but it is a major problem with the interpretation of mHi-C's benefits with respect to reproducibility, which is stated many times throughout the manuscript.

We would like to emphasize that the improvement in reproducibility is due to increase in read depth by correctly assigned multi-reads. That said, we welcomed the opportunity to investigate whether there is a systematic bias in multi-read assignment. We looked at this tissue from two angles. First, if there is a systematic bias in multi-read assignment, one might expect the reproducibility of unrelated samples to increase by incorporation of multi-reads. In Figure 2B and Figure 2—figure supplements 9 and 10, we showed that mHi-C leads to significant gains in reproducibility for IMR90 and GM12878. In contrast, Figure 2—figure supplement 12 presents the results from a pairwise replicate reproducibility analysis between 4 replicates of GM12878 and 6 replicates of IMR90 and shows that incorporation of multi-reads do not lead to any significant gain in reproducibility for replicates from unrelated samples (IMR90 vs GM12878) (all Wilcoxon rank-sum test p-values of the pairwise comparisons between Uni- and Uni&Multi-settings > 0.2).

Next, we performed the calculations suggested by the reviewer in the trimming experiments. Figure 7—figure supplements 2 and 3 show that reproducibility across the four replicates of A549 based on the uni-reads of the original read length is higher than the levels achievable by the Uni&Multi-Setting at trimmed read lengths. These two points are incorporated in the text.

In addition, we examined all the incorrectly allocated multi-reads in trimming experiments to explicitly assess whether these multi-reads were consistently being assigned to the same incorrect locations across replicates regardless of the replicate experiment-specific biological signal. The trimmed datasets have uni-reads of replicates 1 to 4 combined with multi-reads resulting from trimming of replicate 2 uni-reads. In each replicate dataset, mHi-C ends up either assigning each multi-read to its true originating location or to an incorrect location. Unless assigned to the true origin, each multi-read can potentially be misassigned to up to 4 different positions (i.e., one wrong location per replicate). Author response image 1 displays the distribution of the numbers of misassigned multi-reads assigned to exactly 1, 2, 3, and 4 locations. We observe that a large portion of the multi-reads are assigned to the same location across the four replicates – while this proportion is large, it is still only 4.78% to 7.79% of all the multi-reads. To evaluate whether these incorrect assignments are nonetheless consistent with the available replicate-specific biological signal, we asked whether their assigned positions corresponded to the ones with the highest local uni-read counts among the candidate positions of the multi-read within each replicate, i.e., comparing the local uni-read counts of all the available assignment positions for the multi-read within a replicate. This analysis indicated that, at all the trimmed read lengths, only a small fraction of the multi-reads (less than 12% for trimmed read length of 36bp and less than 4% for other read lengths and these percentages correspond to 1.45% and 0.76% of all the multi-reads in their respective settings), that were incorrectly assigned to the same location across the four replicates, were not assigned to the location with the maximum local uni-read signal. For the rest of the incorrectly assigned multi-reads, the final allocation position either had the highest local uni-read signal (56% to 61% of the incorrectly assigned multi-reads across all the trimmed read lengths) or had maximum local uni-read signal of zero.

Author response image 1. — mHi-C utilizes the trimmed uni-reads individually from four replicates to assign the same trimmed multi-reads from replicate 2 in the analysis of each trimmed replicate experiment. Each multi-read is either assigned to its true origin or can be incorrectly assigned to up to four different positions. Multi-reads that were incorrectly assigned to the same position are further stratified into three categories as: (i) assigned to the candidate position with the highest uni-reads signal (pink) (7.77% of all the multi-reads for trimming at 36bp); (ii) not assigned to the highest uni-reads enriched position (purple) (1.45% of all the multi-reads for trimming at 36bp); (iii) none of the candidate positions have any uni-reads (orange) (4.64% of all the multi-reads for trimming at 36bp).

The TAD analysis is still not very convincing (Figure 7B). The contact matrices look really similar between all conditions, but the called TADs for the Trimmed Uni-reads looks different for some reason. For example, the big TAD on the upper left doesn't seem to adhere to the likely TAD in the contact map. This may be a quirk of the TAD identification algorithm, but it doesn't make for a convincing visual case. The contact map intensity for many of the figures is getting clipped at local interactions (i.e. the region near the diagonal is essentially the same color of red), making it hard to see where the key differences are that drive the difference in the TAD calling. I would highly recommend either zooming in on smaller regions and/or changing the color scheme/scaling so that the TAD calls and the contact map can be more clearly evaluated by the reader.

Thanks for pointing this out. We updated Figure 7B and Figure 7—figure supplements 4-7 to better highlight the discrepancies in the contact matrices due to the exclusion of multi-reads and the resulting impact on boundary detection. In addition, we adjusted the color scale and zoomed in the region to highlight the major differences. The low sequencing depth in the trimmed Uni-setting does have a profound effect on the detection of TAD boundaries.

Reviewer #3:

The authors have addressed most of my concerns. Two questions remain:

1) Figure 4A: I am confused. First of all, the second track shouldn't be there – that's the whole chromosome. I think what the authors intended to plotted is the region in the tiny blue box. Second comment about this figure: if you look at the first track (virtual 4C), in the middle, there is a strong Uni&Multi peak, but when you look at the bottom two tracks (arcs), it shows it is uni-specific interaction. Can author clarify what happened?

We have removed the second track of the complete genome in Figure 4A and Figure 4—figure supplements 1 and 2. The following clarification addresses the second comment. The last track in Figure 4A contains all the significant interactions under Uni-setting and thus includes the ones that are common between the Uni- and Uni&Multi-settings. Originally, the second to the last track highlights all the novel significant interactions identified under Uni&Multi-setting, apart from those in the last track. Therefore, there is also a significant interaction from the region with a strong Uni&Multi-peak in the middle of the first track under Uni&Multi-setting. For clarity, we have changed the second to the last track into Uni&Multi-setting and therefore the ones not in the last track are novel promoter-enhancer interactions.

2) Regarding this response about its performance on normalized Hi-C matrix, the authors commented that "We updated all the visualizations to display both the normalized and unnormalized versions (Figure 2A, Figure 2—figure supplements 1-4). While the normalized Uni-setting matrices look less incomplete highlighting the impact of normalization, mHi-C generated matrices look visually more complete and display the impact of multi-reads. We provided several such examples as supplementary figures."

I found the answer is not satisfactory – the authors need to provide quantitative evaluation of this claim.

We extended the original coverage analysis and directly quantified the difference between the normalized contact matrices under the Uni- and Uni&Multi-settings to highlight coverage improvement due to multi-reads.

The following paragraph, included in the main text, summarizes this quantification.

“Quantitatively, for the combined replicates of GM12878, 99.61% of the 5 kb bins with interaction potential are covered by at least 100 raw contacts under the Uni&Multi-setting, compared to 98.72% under Uni-setting, thereby allowing us to study 25.55Mb more of the genome. […] This also highlights that multi-reads alleviate the inflation of low raw contact count regions due to normalization. These major improvements in coverage provide direct evidence that mHi-C is rescuing multi-reads that originate from biologically valid fragments.”

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Citations

Zheng Y, Ay F. 2018. Data from: Generative Modeling of Multi-mapping Reads with mHi-C Advances Analysis of Hi-C Studies. Dryad Digital Repository. [DOI] [PMC free article] [PubMed]
Jin F, Li Y, Dixon JR, Selvaraj S, Ye Z, Lee AY, Yen CA, Schmitt AD, Espinoza C, Ren B. 2013. IMR90 Hi-C Dataset. NCBI Gene Expression Omnibus. GSE43070
Ay F, Bunnik EM, Varoquaux N, Bol SM, Prudhomme J, Vert JP, Noble WS, Le Roch KG. 2014. Plasmodium Hi-C Dataset. NCBI Gene Expression Omnibus. GSE50199
Rao SSP, Huntley MH, Durand NC, Stamenova EK, Bochkov ID, Robinson JT, Sanborn AL, Machol I, Omer AD, Lander ES, Aiden EL A. 2014. GM12878 Hi-C Dataset. NCBI Gene Expression Omnibus. GSE63525
Dixon JR, Selvaraj S, Yue F, Kim A, Li Y, Shen Y, Hu M, Liu JS, Ren B. 2012. ESC(2012) Hi-C Dataset. NCBI Gene Expression Omnibus. GSE35156
Dixon JR, Xu J, Dileep V, Zhan Y, Song F, Le VT, Galip Gurkan Yardımcı AC, Bann DV, Wang Y, Clark R, Zhang L, Yang H, Liu T, Iyyanki S, An L, Pool C, Sasaki T, Rivera-Mulia JC. 2018. A549 Hi-C Dataset. NCBI Gene Expression Omnibus. GSE92819
Bonev B, Cohen NM, Szabo Q. 2017. ESC(2017) & Cortex Hi-C Datasets. NCBI Gene Expression Omnibus. GSE96107

Supplementary Materials

Figure 1—source data 1. Detailed summary of study datasets.

elife-38070-fig1-data1.xlsx^{(31KB, xlsx)}

DOI: 10.7554/eLife.38070.009

Figure 3—source data 1. Percentage of improvement in the number of significant interactions across six studies at resolution 40 kb.

elife-38070-fig3-data1.xlsx^{(11.2KB, xlsx)}

DOI: 10.7554/eLife.38070.043

Figure 4—source data 1. The number of significant promoter-enhancer Hi-C interactions at FDR 5% under Uni-setting and Uni&Multi-setting, respectively, for six replicates of IMR90.

elife-38070-fig4-data1.xlsx^{(11.5KB, xlsx)}

DOI: 10.7554/eLife.38070.049

Figure 4—source data 2. Significant promoter-enhancer interactions at FDR 5% under Uni-setting and Uni&Multi-setting for six replicates of IMR90 with the number of contacts.

elife-38070-fig4-data2.zip^{(13.5MB, zip)}

DOI: 10.7554/eLife.38070.050

Figure 5—source data 1. Topologically associating domains detected by DomainCaller (Dixon et al., 2012) under Uni&Multi-setting for six replicates of IMR90.

elife-38070-fig5-data1.zip^{(94.5KB, zip)}

DOI: 10.7554/eLife.38070.064

Figure 5—source data 2. Topologically associating domains detected by Arrowhead (Rao et al., 2014) under Uni&Multi-setting for ten replicates of GM12878.

elife-38070-fig5-data2.zip^{(380.2KB, zip)}

DOI: 10.7554/eLife.38070.065

Supplementary file 1. Hi-C and mHi-C terminology.

elife-38070-supp1.pdf^{(631.6KB, pdf)}

DOI: 10.7554/eLife.38070.086

Transparent reporting form

elife-38070-transrepform.docx^{(250.9KB, docx)}

DOI: 10.7554/eLife.38070.087

Data Availability Statement

The following dataset was generated:

Zheng Y, Ay F. 2018. Data from: Generative Modeling of Multi-mapping Reads with mHi-C Advances Analysis of Hi-C Studies. Dryad Digital Repository.

The following previously published datasets were used:

Jin F, Li Y, Dixon JR, Selvaraj S, Ye Z, Lee AY, Yen CA, Schmitt AD, Espinoza C, Ren B. 2013. IMR90 Hi-C Dataset. NCBI Gene Expression Omnibus. GSE43070

Ay F, Bunnik EM, Varoquaux N, Bol SM, Prudhomme J, Vert JP, Noble WS, Le Roch KG. 2014. Plasmodium Hi-C Dataset. NCBI Gene Expression Omnibus. GSE50199

Rao SSP, Huntley MH, Durand NC, Stamenova EK, Bochkov ID, Robinson JT, Sanborn AL, Machol I, Omer AD, Lander ES, Aiden EL A. 2014. GM12878 Hi-C Dataset. NCBI Gene Expression Omnibus. GSE63525

Dixon JR, Selvaraj S, Yue F, Kim A, Li Y, Shen Y, Hu M, Liu JS, Ren B. 2012. ESC(2012) Hi-C Dataset. NCBI Gene Expression Omnibus. GSE35156

Bonev B, Cohen NM, Szabo Q. 2017. ESC(2017) & Cortex Hi-C Datasets. NCBI Gene Expression Omnibus. GSE96107

[bib1] Ay F, Bailey TL, Noble WS. Statistical confidence estimation for Hi-C data reveals regulatory chromatin contacts. Genome Research. 2014a;24:999–1011. doi: 10.1101/gr.160374.113. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib2] Ay F, Bunnik EM, Varoquaux N, Bol SM, Prudhomme J, Vert JP, Noble WS, Le Roch KG. Three-dimensional modeling of the P. falciparum genome during the erythrocytic cycle reveals a strong connection between genome architecture and gene expression. Genome Research. 2014b;24:974–988. doi: 10.1101/gr.169417.113. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib3] Ay F, Noble WS. Analysis methods for studying the 3D architecture of the genome. Genome Biology. 2015;16:183. doi: 10.1186/s13059-015-0745-7. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib4] Barrett T, Wilhite SE, Ledoux P, Evangelista C, Kim IF, Tomashevsky M, Marshall KA, Phillippy KH, Sherman PM, Holko M, Yefanov A, Lee H, Zhang N, Robertson CL, Serova N, Davis S, Soboleva A. NCBI GEO: archive for functional genomics data sets—update. Nucleic Acids Research. 2013;41:D991–D995. doi: 10.1093/nar/gks1193. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib5] Belaghzal H, Dekker J, Gibcus JH. Hi-C 2.0: an optimized Hi-C procedure for high-resolution genome-wide mapping of chromosome conformation. Methods. 2017;123:56–65. doi: 10.1016/j.ymeth.2017.04.004. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib6] Bonev B, Mendelson Cohen N, Szabo Q, Fritsch L, Papadopoulos GL, Lubling Y, Xu X, Lv X, Hugnot JP, Tanay A, Cavalli G. Multiscale 3D genome rewiring during mouse neural development. Cell. 2017;171:557–572. doi: 10.1016/j.cell.2017.09.043. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib7] Bunnik EM, Cook KB, Varoquaux N, Batugedara G, Prudhomme J, Cort A, Shi L, Andolina C, Ross LS, Brady D, Fidock DA, Nosten F, Tewari R, Sinnis P, Ay F, Vert JP, Noble WS, Le Roch KG. Changes in genome organization of parasite-specific gene families during the plasmodium transmission stages. Nature Communications. 2018;9 doi: 10.1038/s41467-018-04295-5. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib8] Chung D, Kuan PF, Li B, Sanalkumar R, Liang K, Bresnick EH, Dewey C, Keleş S. Discovering transcription factor binding sites in highly repetitive regions of genomes with multi-read analysis of ChIP-Seq data. PLoS Computational Biology. 2011;7:e1002111. doi: 10.1371/journal.pcbi.1002111. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib9] Corradin O, Cohen AJ, Luppino JM, Bayles IM, Schumacher FR, Scacheri PC. Modeling disease risk through analysis of physical interactions between genetic variants within chromatin regulatory circuitry. Nature Genetics. 2016;48:1313–1320. doi: 10.1038/ng.3674. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib10] Cournac A, Koszul R, Mozziconacci J. The 3D folding of metazoan genomes correlates with the association of similar repetitive elements. Nucleic Acids Research. 2016;44:245–255. doi: 10.1093/nar/gkv1292. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib11] de Laat W, Duboule D. Topology of mammalian developmental enhancers and their regulatory landscapes. Nature. 2013;502:499–506. doi: 10.1038/nature12753. [DOI] [PubMed] [Google Scholar]

[bib12] Dekker J, Rippe K, Dekker M, Kleckner N. Capturing chromosome conformation. Science. 2002;295:1306–1311. doi: 10.1126/science.1067799. [DOI] [PubMed] [Google Scholar]

[bib13] Dixon JR, Selvaraj S, Yue F, Kim A, Li Y, Shen Y, Hu M, Liu JS, Ren B. Topological domains in mammalian genomes identified by analysis of chromatin interactions. Nature. 2012;485:376–380. doi: 10.1038/nature11082. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib14] Dixon JR, Jung I, Selvaraj S, Shen Y, Antosiewicz-Bourget JE, Lee AY, Ye Z, Kim A, Rajagopal N, Xie W, Diao Y, Liang J, Zhao H, Lobanenkov VV, Ecker JR, Thomson JA, Ren B. Chromatin architecture reorganization during stem cell differentiation. Nature. 2015;518:331–336. doi: 10.1038/nature14222. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib15] Dixon JR, Xu J, Dileep V, Zhan Y, Song F, Le VT, Yardımcı GG, Chakraborty A, Bann DV, Wang Y, Clark R, Zhang L, Yang H, Liu T, Iyyanki S, An L, Pool C, Sasaki T, Rivera-Mulia JC, Ozadam H, Lajoie BR, Kaul R, Buckley M, Lee K, Diegel M, Pezic D, Ernst C, Hadjur S, Odom DT, Stamatoyannopoulos JA, Broach JR, Hardison RC, Ay F, Noble WS, Dekker J, Gilbert DM, Yue F. Integrative detection and analysis of structural variation in cancer genomes. Nature Genetics. 2018;50:1388–1398. doi: 10.1038/s41588-018-0195-8. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib16] Durand NC, Robinson JT, Shamim MS, Machol I, Mesirov JP, Lander ES, Aiden EL. Juicebox provides a visualization system for Hi-C contact maps with unlimited zoom. Cell Systems. 2016;3:99–101. doi: 10.1016/j.cels.2015.07.012. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib17] ENCODE Project Consortium An integrated encyclopedia of DNA elements in the human genome. Nature. 2012;489:57–74. doi: 10.1038/nature11247. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib18] Ferrari KJ, Scelfo A, Jammula S, Cuomo A, Barozzi I, Stützer A, Fischle W, Bonaldi T, Pasini D. Polycomb-dependent H3K27me1 and H3K27me2 regulate active transcription and enhancer fidelity. Molecular Cell. 2014;53:49–62. doi: 10.1016/j.molcel.2013.10.030. [DOI] [PubMed] [Google Scholar]

[bib19] Forcato M, Nicoletti C, Pal K, Livi CM, Ferrari F, Bicciato S. Comparison of computational methods for Hi-C data analysis. Nature Methods. 2017;14:679–685. doi: 10.1038/nmeth.4325. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib20] Grant CE, Bailey TL, Noble WS. FIMO: scanning for occurrences of a given motif. Bioinformatics. 2011;27:1017–1018. doi: 10.1093/bioinformatics/btr064. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib21] Harrow J, Frankish A, Gonzalez JM, Tapanari E, Diekhans M, Kokocinski F, Aken BL, Barrell D, Zadissa A, Searle S, Barnes I, Bignell A, Boychenko V, Hunt T, Kay M, Mukherjee G, Rajan J, Despacio-Reyes G, Saunders G, Steward C, Harte R, Lin M, Howald C, Tanzer A, Derrien T, Chrast J, Walters N, Balasubramanian S, Pei B, Tress M, Rodriguez JM, Ezkurdia I, van Baren J, Brent M, Haussler D, Kellis M, Valencia A, Reymond A, Gerstein M, Guigó R, Hubbard TJ. GENCODE: the reference human genome annotation for the ENCODE project. Genome Research. 2012;22:1760–1774. doi: 10.1101/gr.135350.111. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib22] Heinz S, Benner C, Spann N, Bertolino E, Lin YC, Laslo P, Cheng JX, Murre C, Singh H, Glass CK. Simple combinations of lineage-determining transcription factors prime cis-regulatory elements required for macrophage and B cell identities. Molecular Cell. 2010;38:576–589. doi: 10.1016/j.molcel.2010.05.004. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib23] Hsu SC, Gilgenast TG, Bartman CR, Edwards CR, Stonestrom AJ, Huang P, Emerson DJ, Evans P, Werner MT, Keller CA, Giardine B, Hardison RC, Raj A, Phillips-Cremins JE, Blobel GA. The BET protein BRD2 cooperates with CTCF to enforce transcriptional and architectural boundaries. Molecular Cell. 2017;66:102–116. doi: 10.1016/j.molcel.2017.02.027. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib24] Hwang YC, Lin CF, Valladares O, Malamon J, Kuksa PP, Zheng Q, Gregory BD, Wang LS. HIPPIE: a high-throughput identification pipeline for promoter interacting enhancer elements. Bioinformatics. 2015;31:1290–1292. doi: 10.1093/bioinformatics/btu801. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib25] Imakaev M, Fudenberg G, McCord RP, Naumova N, Goloborodko A, Lajoie BR, Dekker J, Mirny LA. Iterative correction of Hi-C data reveals hallmarks of chromosome organization. Nature Methods. 2012;9:999–1003. doi: 10.1038/nmeth.2148. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib26] Javierre BM, Burren OS, Wilder SP, Kreuzhuber R, Hill SM, Sewitz S, Cairns J, Wingett SW, Várnai C, Thiecke MJ, Burden F, Farrow S, Cutler AJ, Rehnström K, Downes K, Grassi L, Kostadima M, Freire-Pritchett P, Wang F, Stunnenberg HG, Todd JA, Zerbino DR, Stegle O, Ouwehand WH, Frontini M, Wallace C, Spivakov M, Fraser P, BLUEPRINT Consortium Lineage-Specific genome architecture links enhancers and Non-coding disease variants to target gene promoters. Cell. 2016;167:1369–1384. doi: 10.1016/j.cell.2016.09.037. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib27] Jin F, Li Y, Dixon JR, Selvaraj S, Ye Z, Lee AY, Yen CA, Schmitt AD, Espinoza CA, Ren B. A high-resolution map of the three-dimensional chromatin interactome in human cells. Nature. 2013;503:290–294. doi: 10.1038/nature12644. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib28] Kerpedjiev P, Abdennur N, Lekschas F, McCallum C, Dinkla K, Strobelt H, Luber JM, Ouellette SB, Ahzir A, Kumar N. HiGlass: web-based visual comparison and exploration of genome interaction maps. Genome Biology . 2017 doi: 10.1186/s13059-018-1486-1. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib29] Khan A, Fornes O, Stigliani A, Gheorghe M, Castro-Mondragon JA, van der Lee R, Bessy A, Chèneby J, Kulkarni SR, Tan G. JASPAR 2018: update of the open-access database of transcription factor binding profiles and its web framework. Nucleic Acids Research. 2017 doi: 10.1093/nar/gkx1126. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib30] Knight PA, Ruiz D. A fast algorithm for matrix balancing. IMA Journal of Numerical Analysis. 2013;33:1029–1047. doi: 10.1093/imanum/drs019. [DOI] [Google Scholar]

[bib31] Kundaje A, Meuleman W, Ernst J, Bilenky M, Yen A, Heravi-Moussavi A, Kheradpour P, Zhang Z, Wang J, Ziller MJ, Amin V, Whitaker JW, Schultz MD, Ward LD, Sarkar A, Quon G, Sandstrom RS, Eaton ML, Wu YC, Pfenning AR, Wang X, Claussnitzer M, Liu Y, Coarfa C, Harris RA, Shoresh N, Epstein CB, Gjoneska E, Leung D, Xie W, Hawkins RD, Lister R, Hong C, Gascard P, Mungall AJ, Moore R, Chuah E, Tam A, Canfield TK, Hansen RS, Kaul R, Sabo PJ, Bansal MS, Carles A, Dixon JR, Farh KH, Feizi S, Karlic R, Kim AR, Kulkarni A, Li D, Lowdon R, Elliott G, Mercer TR, Neph SJ, Onuchic V, Polak P, Rajagopal N, Ray P, Sallari RC, Siebenthall KT, Sinnott-Armstrong NA, Stevens M, Thurman RE, Wu J, Zhang B, Zhou X, Beaudet AE, Boyer LA, De Jager PL, Farnham PJ, Fisher SJ, Haussler D, Jones SJ, Li W, Marra MA, McManus MT, Sunyaev S, Thomson JA, Tlsty TD, Tsai LH, Wang W, Waterland RA, Zhang MQ, Chadwick LH, Bernstein BE, Costello JF, Ecker JR, Hirst M, Meissner A, Milosavljevic A, Ren B, Stamatoyannopoulos JA, Wang T, Kellis M, Roadmap Epigenomics Consortium Integrative analysis of 111 reference human epigenomes. Nature. 2015;518:317–330. doi: 10.1038/nature14248. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib32] Li B, Dewey CN. RSEM: accurate transcript quantification from RNA-Seq data with or without a reference genome. BMC Bioinformatics. 2011;12:323. doi: 10.1186/1471-2105-12-323. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib33] Li H, Durbin R. Fast and accurate long-read alignment with Burrows-Wheeler transform. Bioinformatics. 2010;26:589–595. doi: 10.1093/bioinformatics/btp698. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib34] Lieberman-Aiden E, van Berkum NL, Williams L, Imakaev M, Ragoczy T, Telling A, Amit I, Lajoie BR, Sabo PJ, Dorschner MO, Sandstrom R, Bernstein B, Bender MA, Groudine M, Gnirke A, Stamatoyannopoulos J, Mirny LA, Lander ES, Dekker J. Comprehensive mapping of long-range interactions reveals folding principles of the human genome. Science. 2009;326:289–293. doi: 10.1126/science.1181369. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib35] Lun AT, Smyth GK. diffHic: a bioconductor package to detect differential genomic interactions in Hi-C data. BMC Bioinformatics. 2015;16:258. doi: 10.1186/s12859-015-0683-0. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib36] Martin M. Cutadapt removes adapter sequences from high-throughput sequencing reads. EMBnet.journal. 2011;17:10. doi: 10.14806/ej.17.1.200. [DOI] [Google Scholar]

[bib37] Mifsud B, Tavares-Cadete F, Young AN, Sugar R, Schoenfelder S, Ferreira L, Wingett SW, Andrews S, Grey W, Ewels PA, Herman B, Happe S, Higgs A, LeProust E, Follows GA, Fraser P, Luscombe NM, Osborne CS. Mapping long-range promoter contacts in human cells with high-resolution capture Hi-C. Nature Genetics. 2015;47:598–606. doi: 10.1038/ng.3286. [DOI] [PubMed] [Google Scholar]

[bib38] Ong CT, Corces VG. CTCF: an architectural protein bridging genome topology and function. Nature Reviews Genetics. 2014;15:234–246. doi: 10.1038/nrg3663. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib39] Open R RepeatMasker. 4.02015 https://www.repeatmasker.org

[bib40] Pombo A, Dillon N. Three-dimensional genome architecture: players and mechanisms. Nature Reviews Molecular Cell Biology. 2015;16:245–257. doi: 10.1038/nrm3965. [DOI] [PubMed] [Google Scholar]

[bib41] Rao SS, Huntley MH, Durand NC, Stamenova EK, Bochkov ID, Robinson JT, Sanborn AL, Machol I, Omer AD, Lander ES, Aiden EL. A 3D map of the human genome at Kilobase resolution reveals principles of chromatin looping. Cell. 2014;159:1665–1680. doi: 10.1016/j.cell.2014.11.021. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib42] Rosa-Garrido M, Chapski DJ, Schmitt AD, Kimball TH, Karbassi E, Monte E, Balderas E, Pellegrini M, Shih TT, Soehalim E, Liem D, Ping P, Galjart NJ, Ren S, Wang Y, Ren B, Vondriska TM. High-Resolution mapping of chromatin conformation in cardiac myocytes reveals structural remodeling of the epigenome in heart failure. Circulation. 2017;136:1613–1625. doi: 10.1161/CIRCULATIONAHA.117.029430. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib43] Safran M, Dalah I, Alexander J, Rosen N, Iny Stein T, Shmoish M, Nativ N, Bahir I, Doniger T, Krug H, Sirota-Madi A, Olender T, Golan Y, Stelzer G, Harel A, Lancet D. GeneCards version 3: the human gene integrator. Database. 2010;2010:baq020. doi: 10.1093/database/baq020. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib44] Servant N, Varoquaux N, Lajoie BR, Viara E, Chen CJ, Vert JP, Heard E, Dekker J, Barillot E. HiC-Pro: an optimized and flexible pipeline for Hi-C data processing. Genome Biology. 2015;16:259. doi: 10.1186/s13059-015-0831-x. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib45] Spielmann M, Lupiáñez DG, Mundlos S. Structural variation in the 3D genome. Nature Reviews Genetics. 2018;19:453–467. doi: 10.1038/s41576-018-0007-0. [DOI] [PubMed] [Google Scholar]

[bib46] Sun JH, Zhou L, Emerson DJ, Phyo SA, Titus KR, Gong W, Gilgenast TG, Beagan JA, Davidson BL, Tassone F, Phillips-Cremins JE. Disease-Associated short tandem repeats Co-localize with chromatin domain boundaries. Cell. 2018;175:224–238. doi: 10.1016/j.cell.2018.08.005. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib47] Tang Z, Luo OJ, Li X, Zheng M, Zhu JJ, Szalaj P, Trzaskoma P, Magalska A, Wlodarczyk J, Ruszczycki B, Michalski P, Piecuch E, Wang P, Wang D, Tian SZ, Penrad-Mobayed M, Sachs LM, Ruan X, Wei CL, Liu ET, Wilczynski GM, Plewczynski D, Li G, Ruan Y. CTCF-Mediated human 3D genome architecture reveals chromatin topology for transcription. Cell. 2015;163:1611–1627. doi: 10.1016/j.cell.2015.11.024. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib48] Treangen TJ, Salzberg SL. Repetitive DNA and next-generation sequencing: computational challenges and solutions. Nature Reviews Genetics. 2012;13:36–46. doi: 10.1038/nrg3117. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib49] Tyner C, Barber GP, Casper J, Clawson H, Diekhans M, Eisenhart C, Fischer CM, Gibson D, Gonzalez JN, Guruvadoo L, Haeussler M, Heitner S, Hinrichs AS, Karolchik D, Lee BT, Lee CM, Nejad P, Raney BJ, Rosenbloom KR, Speir ML, Villarreal C, Vivian J, Zweig AS, Haussler D, Kuhn RM, Kent WJ. The ucsc genome browser database: 2018 update. Nucleic Acids Research. 2017;45 doi: 10.1093/nar/gkw1134. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib50] Won H, de la Torre-Ubieta L, Stein JL, Parikshak NN, Huang J, Opland CK, Gandal MJ, Sutton GJ, Hormozdiari F, Lu D, Lee C, Eskin E, Voineagu I, Ernst J, Geschwind DH. Chromosome conformation elucidates regulatory relationships in developing human brain. Nature. 2016;538:523–527. doi: 10.1038/nature19847. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib51] Xie M, Hong C, Zhang B, Lowdon RF, Xing X, Li D, Zhou X, Lee HJ, Maire CL, Ligon KL, Gascard P, Sigaroudinia M, Tlsty TD, Kadlecek T, Weiss A, O'Geen H, Farnham PJ, Madden PA, Mungall AJ, Tam A, Kamoh B, Cho S, Moore R, Hirst M, Marra MA, Costello JF, Wang T. DNA hypomethylation within specific transposable element families associates with tissue-specific enhancer landscape. Nature Genetics. 2013;45:836–841. doi: 10.1038/ng.2649. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib52] Yang T, Zhang F, Yardımcı GG, Song F, Hardison RC, Noble WS, Yue F, Li Q. HiCRep: assessing the reproducibility of Hi-C data using a stratum-adjusted correlation coefficient. Genome Research. 2017;27:1939–1949. doi: 10.1101/gr.220640.117. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib53] Yardımcı G, Özadam H, Sauria ME, Ursu O, Yan K-K, Yang T, Chakraborty A, Kaul A, Lajoie BR, Song F. Measuring the reproducibility and quality of Hi-C data. bioRxiv. 2017 doi: 10.1101/188755. [DOI] [PMC free article] [PubMed]

[bib54] Yu M, Ren B. The Three-Dimensional organization of mammalian genomes. Annual Review of Cell and Developmental Biology. 2017;33:265–289. doi: 10.1146/annurev-cellbio-100616-060531. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib55] Zeng X, Li B, Welch R, Rojo C, Zheng Y, Dewey CN, Keleş S. Perm-seq: mapping Protein-DNA interactions in segmental duplication and highly repetitive regions of genomes with Prior-Enhanced read mapping. PLOS Computational Biology. 2015;11:e1004491. doi: 10.1371/journal.pcbi.1004491. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib56] Zhang Q, Keleş S. CNV-guided multi-read allocation for ChIP-seq. Bioinformatics. 2014;30:2860–2867. doi: 10.1093/bioinformatics/btu402. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib57] Zhang Z, Xing Y. CLIP-seq analysis of multi-mapped reads discovers novel functional RNA regulatory sites in the human transcriptome. Nucleic Acids Research. 2017;45:9260–9271. doi: 10.1093/nar/gkx646. [DOI] [PMC free article] [PubMed] [Google Scholar]

[bib58] Zheng Y, Keleş S. GitHub; 2019. https://github.com/keleslab/mHiC [Google Scholar]

[bib59] Zhou X, Maricque B, Xie M, Li D, Sundaram V, Martin EA, Koebbe BC, Nielsen C, Hirst M, Farnham P, Kuhn RM, Zhu J, Smirnov I, Kent WJ, Haussler D, Madden PA, Costello JF, Wang T. The human epigenome browser at Washington university. Nature Methods. 2011;8:989–990. doi: 10.1038/nmeth.1772. [DOI] [PMC free article] [PubMed] [Google Scholar]

PERMALINK

Generative modeling of multi-mapping reads with mHi-C advances analysis of Hi-C studies

Ye Zheng

Ferhat Ay

Sunduz Keles

Roles

Abstract

Introduction

Figure 1. Overview of multi-reads and mHi-C pipeline.

Figure 1—figure supplement 1. mHi-C pipeline (Alignment - Read end pairing - Valid fragment filtering).

Figure 1—figure supplement 2. mHi-C pipeline (Duplicate removal - Genome binning - mHi-C).

Figure 1—figure supplement 3. Coverage and cis-to-trans ratios across individual replicates of the study datasets as indicators of data quality.

Figure 1—figure supplement 4. Percentages of (A) mappable and (B) valid reads over the set of all reads for individual replicates of the study datasets as an indicator of data quality.

Figure 1—figure supplement 5. Categorization of reads after alignment across study datasets.

Figure 1—figure supplement 6. Comparison of the prevalence of multi-reads and chimeric reads, both of which require additional processing.

Results

Multi-reads significantly increase the sequencing depths of Hi-C data

Table 1. Hi-C Data Summary.

Multi-reads can be rescued at multiple processing stages of mHi-C pipeline

Probabilistic assignment of multi-reads results in more complete contact matrices and significantly improves reproducibility across replicates

Figure 2. Global impact of multi-reads in Hi-C analysis.

Figure 2—figure supplement 1. Raw and normalized contact matrices of GM12878 under Uni-setting and Uni&Multi-setting on chromosome 1.

Figure 2—figure supplement 2. Raw and normalized contact matrices of GM12878 under Uni-setting and Uni&Multi-setting on chromosome 2.

Figure 2—figure supplement 3. Raw and normalized contact matrices of GM12878 under Uni-setting and Uni&Multi-setting on chromosome 3.

Figure 2—figure supplement 4. Raw and normalized contact matrices of GM12878 under Uni-setting and Uni&Multi-setting on chromosome 5.

Figure 2—figure supplement 6. Bin coverage improvement of raw contact matrices under Uni&Multi-setting compared to Uni-setting for GM12878 with combined reads from replicates 2–9 at 5 kb.

Figure 2—figure supplement 7. Bin coverage improvement of raw contact matrices under Uni&Multi-setting compared to Uni-setting for IMR90 at the individual replicate level for two different allocation probability thresholds.

Figure 2—figure supplement 8. Bin coverage comparison of normalized contact matrices under Uni&Multi- and Uni-settings for GM12878 with combined reads from replicates 2–9 at 5 kb.

Figure 2—figure supplement 9. Reproducibility at the contact matrix level under the Uni- and Uni&Multi-settings in A549, ESC-2017 and Cortex cell lines.

Figure 2—figure supplement 10. Reproducibility at the contact matrix level at resolutions 40 kb (low) and 10 kb (high) across study datasets.

Figure 2—figure supplement 11. Percent improvement in reproducibility due to the Uni&Multi-setting versus the proportion of the number of valid multi-reads compared to the number of the uni-reads in the datasets.

Figure 2—figure supplement 12. Reproducibility at the contact matrix level under the Uni- and Uni&Multi-settings between GM12878 and IMR90 at 40 kb resolution.

Figure 2—figure supplement 13. Reproducibility of significant interactions for IMR90.

2.4 Multi-reads detect novel significant interactions

Figure 3. Gain in the numbers of novel significant interactions by mHi-C and their characterization by chromatin marks.

Figure 3—figure supplement 1. Percentage change in the numbers of significant interactions under the Uni&Multi-setting compared to Uni-setting at 0.1%, 1%, 5% and 10% FDR thresholds and resolutions (A) 40 kb and (B) 10 kb.

Figure 3—figure supplement 2. Comparison of significant interactions as a function of posterior probabilities of multi-read assignment (IMR90 40 kb).

Figure 3—figure supplement 3. Heatmap for marginal correlations of percentage increase in the number of identified significant interactions (FDR 5%) with indicators of data quality across study datasets excluding P. falciparum at 40 kb.

Figure 3—figure supplement 4. Percentage change in the numbers of significant interactions with respect to cis-to-trans ratio excluding P. falciparum at 40 kb.

Figure 3—figure supplement 5. Percentage change in the numbers of significant interactions of GM12878 datasets at different resolutions.

Figure 3—figure supplement 6. Percentage change in the numbers of significant interactions with respect to coverage at 40 kb.

Figure 3—figure supplement 7. Percentage change in the numbers of significant interactions as a function of the percentage of mHi-C rescued multi-reads in comparison to uni-reads and cis-to-trans ratios at 40 kb.

Figure 3—figure supplement 8. Recovery of significant interactions identified at FDR 1% by analysis at FDR 10% for each of six replicates of IMR90 at 40 kb.

Figure 3—figure supplement 9. Recovery of significant interactions identified at FDR 1% by analysis at FDR 10% for each of four replicates of GM12878 at 40 kb resolution.

Figure 3—figure supplement 10. Recovery of significant interactions identified at FDR 1% by analysis at FDR 10% for each of four replicates of GM12878 at 10 kb resolution.

Figure 3—figure supplement 11. Recovery of significant interactions identified at FDR 1% by analysis at FDR 10% for each of ten replicates of GM12878 at 5 kb resolution.

Figure 3—figure supplement 12. Recovery of significant interactions identified at FDR 1% by analysis at FDR 10% for GM12878 summed across replicates at 5 kb, 10 kb, and 40 kb resolutions.

Figure 3—figure supplement 13. ROC and PR curves for replicates 5 and 6 of IMR90.

Figure 3—figure supplement 14. Quantification of significant interactions for chromHMM states and ChIP-seq peak regions (IMR90).

Figure 3—figure supplement 15. Marginalized Hi-C signal (contact counts aggregated across the genomic coordinates for six replicates of IMR90), ChIP-seq coverage and peaks and gene expression for chr1:16,000,000–18,000,000.

Figure 3—figure supplement 16. Marginalized Hi-C signal (contact counts aggregated across the genomic coordinates for six replicates of IMR90), ChIP-seq coverage and peaks and gene expression for chr2:113460,000–116,000,000.

Figure 3—figure supplement 17. Marginalized Hi-C signal (contact counts aggregated across the genomic coordinates for six replicates of IMR90), ChIP-seq coverage and peaks and gene expression for chr9:66,250,000–66,950,000.

Chromatin features of novel significant interactions

Multi-reads discover novel promoter-enhancer interactions

Figure 4. Novel promoter-enhancer interactions are reproducible and associated with actively expressed genes.

Figure 4—figure supplement 1. Examples of significant promoter-enhancer interactions reproducible among six replicates under Uni- and Uni&Multi-settings (IMR90) on chromosome 7.

Figure 4—figure supplement 2. Examples of significant promoter-enhancer interactions reproducible among 6 replicates under Uni- and Uni&Multi-settings (IMR90) on chromosome 17.

Figure 4—figure supplement 3. Significant promoter-emhancer interactions under Uni- and Uni&Multi-settings across 6 IMR90 replicates (Chromosome 17).

Figure 4—figure supplement 4. Expression distribution of genes promoters of which have significant promoter interactions (IMR90).

Multi-reads refine the boundaries of topologically associating domains

Figure 5. mHi-C rescued multi-reads refine detected topologically associating domains.

Figure 5—figure supplement 1. The number of topologically associating domains (TADs) detected in each chromosome under Uni-setting and Uni&Multi-setting (IMR90).

Figure 5—figure supplement 2. Comparison of CTCF peaks at the boundaries of topologically associating domains (TADs) under Uni-setting and Uni&Multi-setting across six replicates of IMR90.

Figure 5—figure supplement 3. Novel topologically associating domains (TADs) with CTCF peaks at TAD boundaries (IMR90).

Figure 5—figure supplement 4. Existing topologically associating domains (TADs) with adjusted boundaries supported by CTCF peaks at the new TAD boundaries (IMR90).

Figure 5—figure supplement 5. Existing topologically associating domains (TADs) with adjusted boundaries supported by CTCF peaks at the new TAD boundaries (IMR90).

Figure 5—figure supplement 6. False positive topologically associating domains (TADs) detected by the Uni-setting due to the missing reads in low mappability regions (IMR90).

Figure 5—figure supplement 7. False positive topologically associating domains (TADs) detected by the Uni-setting due to the missing reads in low mappability regions (IMR90).

Figure 5—figure supplement 8. False positive topologically associating domains (TADs) detected by the Uni-setting due to the missing reads in low mappability regions (IMR90).

Figure 5—figure supplement 9. False discovery rate of TADs detected under Uni-setting and Uni&Multi-setting (IMR90).

Figure 5—figure supplement 10. Percentage of TAD boundaries co-localized with different types of repetitive elements under Uni-setting and Uni&Multi-setting for IMR90 at 40 kb and GM12878 at 5 kb.

Figure 5—figure supplement 11. Average number of repetitive elements at the reproducible topologically associating domains detected under Uni-setting and Uni&Multi-setting for IMR90 at 40 kb.

Large-scale evaluation of mHi-C with computational trimming experiments and simulations establishes its accuracy

Figure 6. Assessing the accuracy of mHi-C allocation by trimming experiments with the A549 study set of 151 bp reads.

Figure 6—figure supplement 1. Summary of the sequencing depths of the full length and trimmed datasets of A549.

Figure 6—figure supplement 2. Allocation accuracy at the 40 kb resolution among different mappability regions for trimmed reads of varying lengths.

Figure 6—figure supplement 3. Intra-chromosomal and intra&inter-chromosomal allocation accuracy with respect to trimmed read length using uni-reads of replicate 1, 3, and 4 combined with multi-reads of replicate 2 (trimming setting (ii)).

Figure 6—figure supplement 4. Evaluating accuracy of mHi-C allocation with simulations.

Figure 6—figure supplement 5. Allocation accuracy across different mappability regions for trimmed reads of 36 bp, 50 bp, 75 bp, 100 bp, and 125 bp, using uni-reads of replicate 1, 3, and 4, respectively.

Figure 6—figure supplement 6. Allocation accuracy across different classes of repetitive elements at 10 kb and 40 kb resolutions using uni-reads of replicates one, three, and combined with multi-reads of replicate two (trimming setting (ii)).