Abstract
Housekeeping genes (HKGs) generally have fundamental functions in basic biochemical processes in organisms, and usually have relatively steady expression levels across various tissues. They play an important role in the normalization of microarray technology. Using Fourier analysis we transformed gene expression time-series from a Hela cell cycle gene expression dataset into Fourier spectra, and designed an effective computational method for discriminating between HKGs and non-HKGs using the support vector machine (SVM) supervised learning algorithm which can extract significant features of the spectra, providing a basis for identifying specific gene expression patterns. Using our method we identified 510 human HKGs, and then validated them by comparison with two independent sets of tissue expression profiles. Results showed that our predicted HKG set is more reliable than three previously identified sets of HKGs.
Introduction
A housekeeping gene (HKG) is typically a constitutive gene which is required for the maintenance of basic cellular functions, and generally has a steady expression level across various tissues through all phases of cell development irrespective of environmental conditions. This makes HKGs excellent controls for the normalization of Gene Chip technology, and allows the sample quality and consistency of sample quantity on chips to be assessed [1]. The development of high-throughput gene analysis has enabled more precise investigation of gene expression patterns during various cell development phases and has identified some putative characteristics of HKGs. Using the Affymetrix HuGeneFL chip, Warrington et al. [2] and Hsiao et al. [3] identified 533 and 451 HKGs, respectively, from about 7000 genes by sampling 11 and 19 different tissues. Eisenberg et al. [4] subsequently identified a set of HKGs containing 575 genes using data from a more advanced Affymetrix U95A platform based on 47 tissue samples. However, these three HKG sets contain a total of 963 genes, but only have 158 genes in common. This lack of consistency between datasets implies that there exist a number of false positives and negatives within existing HKG sets, and is due to a lack of agreement on the defining characteristics of HKGs. In addition, high levels of background noise and reproducibility problems are difficult to avoid in microarray experiments.
Eisenberg et al. [4] identified several characteristics of HKGs. They proposed that HKGs usually have shorter introns, UTRs and coding sequences, reasoning that a more compact gene structure should facilitate more efficient transcription, particularly in the case of ubiquitously expressed HKGs. A more compact gene structure is consistent with the stable expression of HKGs across tissues and developmental stages since, in comparison with tissue-specific genes, HKGs likely do not require complex transcriptional control. Vinogradov et al. [5] proposed that the intergenic regions between HKGs are also shorter. However, results reported by Zhu et al. [6] on comparisons of ESTs from HKGs and tissue-specific genes suggest that HKGs do not have a compact gene structure, creating some confusion on how the characteristics of HKGs should be defined. Research on HKG gene sequences includes analysis of the frequency of simple sequence repeats (SSR) in the 5′-UTRs [7], content of repetitive sequences [8], and CG-abundance [9]. Farre et al and Zhang et al worked on the evolution and conservation of the gene sequence or the upstream sequence of HKGs and tissue specific genes.
However, even if there was strong agreement on these defining features of HKGs, these characteristics by nature are not powerful or sufficient enough to decisively discriminate between HKG and non-HKG genes. Thus, at present there is no effectual algorithm for reliably predicting HKGs.
Existence of natural bio-rhythms implies that HKGs, which are constitutively expressed in all cell types and phases, may have certain expression frequency patterns. These spectral features can be extracted using harmonic analysis of gene expression time series and used for predicting HKGs. Here, in order to develop a method for discriminating HKGs on the basis of expression features, we introduced discrete Fourier transform of finite length time series [10] into gene expression data analysis, and classified the spectral patterns obtained using machine learning methods. We then constructed an HKG prediction process and obtained and verified a set of 510 HKGs.
Methods
Selection of gene expression time-series data
Fourier analysis requires data with a long series length and high sampling density. Unfortunately, this requirement is much too rigorous for most standard biochemical experiments. In addition, the length of a time series is not easily extended, for example, cells synchronized by serum starvation gradually lose their phase coincidence after several cycles of cell division, thus causing the Gauss distribution to broaden. If cells continue to divide in an unsynchronized manner, cell cycle phases will totally vanish and information from an extended time series will be meaningless.
To satisfy these requirements, we selected a set of human Hela cell gene expression time-series, each with 47 sampling points which were spaced 1 hour apart, covering three cell cycles [11], [12] (http://genome-www.stanford.edu/Human-CellCycle/HeLa/).
Pre-processing of time-series data
It is almost inevitable that there will be some missing data points in a gene expression time series. Here, we eliminated series which had successive missing points or three or more separated missing points, since non-uniform sampling is problematic in Fourier analysis. Series that had one or two separated missing points were interpolated with piecewise cubic Hermite interpolation, a relatively conservative algorithm which does not overshoot and introduces less oscillation (Figure 1), since the expression data were not smooth. In this way we constructed a dataset which contained 32,786 uniform sampling expression time series covering 15,261 genes.
Generally speaking, these time series were not stationary, i.e. their mean values varied with time. In order to uncover the periodical components of the data by Fourier analysis, we eliminated trends and seasonal components using the least squares method with five variation bases, transforming the time series into at least a first order stationary series. The principle of variation used to fit the series with variation bases was to minimize the grand total square errors (Figure 2).
Taking a series with p time points as a vector with p components, , we can approximate the vector with q base functions . The approximate error is minimized when the linear equations are satisfied.
Here we chose five base functions .
The logarithm term was derived from the Frobenius method for second order differential equations which implies that the gene expression time series were continuous and did not contain singularities within the time intervals we concentrated on. Frequency analysis before and after data pre-processing showed the maintenance and enhancement of periodical components in the residual series (Figure 3).
Interpretation of HKGs
Warrington [2], Hsiao [3] and Eisenberg [4] each reported sets of HKGs based on the analysis of tissue microarray experiments. In the Hela cell expression data used here, of the 32,786 effective time series, 234 series corresponded to 158 genes which were common to the above published HKG sets, 1217 series corresponded to the 805 genes which were found in only one or two of the published HKG sets, and 31,335 series corresponded to the 14,297 genes which were not present in any of the published HKG sets (Figure 4). We defined these three collections of genes as Standard HKGs, Putative HKGs and non-HKGs, respectively.
Identification and extraction of the features of HKG spectra
Discrete Fourier transform (DFT) was first applied to time series that had been made stationary in order to enhance the gene expression frequency components of the spectrum. As the time series all contain 47 time points, each separated by 1 hour intervals, we obtained 24 terms from the frequency spectra obtained by applying DFT. The frequency components could be obtained by the formula:
is the length of each time series. The complex numbers are the Fourier spectrum with frequency cycles per sampling point and are the power spectrum. For expression data are real numbers, the first 23 frequency terms are conjugate to the last 23 terms, i.e. . Thus there are only 24 independent components. We used the power spectrum of all these 24 frequency components as our SVM features.
In order to test whether the frequency components of the time series obtained were characteristic features which could be used to distinguish HKGs from non-HKGs, we used a supervised statistical learning method. Generally speaking, whether an HKG expression spectrum has frequency characteristics or not is best determined using Support Vector Machine (SVM). The SVM performed classification by constructing an hyperplane that optimally separates the data into two categories of HKGs and non-HKGs. The goal of SVM modeling was to find the optimal hyperplane that separates clusters of time series in such a way that cases of the HKG category are on one side of the plane and cases of the non-HKG category are on the other size of the plane. Libsvm (Chih-Chung Chang and Chih-Jen Lin, LIBSVM: a library for support vector machines, 2001. http://www.csie.ntu.edu.tw/~cjlin/libsvm) was used here to distinguish between the genes, taking the 24 effective frequency components obtained by Fourier transformation as features. The Gaussian radial basis function (RBF) kernel was adopted with penalty parameter and exponent parameter . The parameter pair was selected by the commonly used cross-validation.
Evaluation using tissue expression profiles
Two independent human tissue expression profiles: GSE2361 [13], expression profiling of 36 types of normal human tissues, and GSE1133 [14], mRNA expression pattern of 79 human tissues, were downloaded from NCBI. Probe intensity data was converted to log2 ratios. Intensity data for different probes corresponding to the same genes were then averaged to represent gene expression levels. The standard deviation (SD) and mean value for each gene across tissues were calculated for each dataset. The coefficient of variation (CV; SD/mean) was obtained.
Gene ontology analysis
A human gene association file (GOC Validation Date: 08/27/2010, CVS Version: Revision: 1.159) was downloaded from the Gene Ontology website [15]. We used the WEGO web server [16] to plot GO results by converting our predicted gene set to the WEGO native format. Only GO level 2 was plotted.
Gene Conservation Analysis
Human hg18 conservation data for 28 vertebrate genomes (phastCons28way) [17] and a hg18 gene table [18] were downloaded from the UCSC web site. The conservation score of each of the HKG and non-HKG was calculated as the mean value of all exon base phastcons scores of their mRNAs. If a gene had more than one mRNA sequence, all mRNA scores were averaged to give a final score.
For a brief summary of the entire process, please see the part 1 of Text S1.
Results
Gene expression frequency spectra can be used as effective characteristics for discriminating HKGs
Since HKGs are genes that commonly have stable expression levels at all growth stages in all organisms, there should be conceivable differences in periodic expression features between HKGs and non-HKGs. For this reason we hypothesized that frequency spectrum features could be used to discriminate between HKGs and non-HKGs. Here, we used Whitfield et al.'s Hela cell dataset which contains the time expression series of 41508 probes. Spectral analysis was performed with Discrete Fourier Transform (DFT), and periodical features were identified and extracted from the frequency statistics obtained using SVM (see Methods section). In order to test whether the Fourier spectrum of a gene is a distinct feature of an HKG, we established two classification models based on 24 frequency components obtained with Fourier analysis: the HN model (HKG/non-HKG; true model) and the NN model (non-HKG/non-HKG; control model). In the HN model, the 234 standard HKG probes were used as positive cases and 234 non-HKGs were selected randomly and used as negative cases for SVM. In the NN, or “control model”, 234 random non-HKG probes were used as positive cases and 234 other non-HKG probes were selected randomly and used as negative cases. Figure 5 shows that the efficiency of the NN model in discriminating between HKGs and non-HKGs is markedly lower than that of the HN model. It is thus evident that HKG frequency components have characteristic structures that can be detected by SVM, indicating that the frequency components of gene expression can be used to effectively discriminate between HKGs and non-HKGs. Computational details are given in the Figure S1 and part 2 of the Text S1.
Prediction of HKGs
As discussed above, the lower than anticipated overlap between the HKG collections published by Warrington [2], Hsiao [3] and Eisenberg [4] indicates the presence of false positives and false negatives within these datasets. The ability of the HN and NN models to discriminate between HKGs and non-HKGs based on frequency components of gene expression shows that prediction and identification of HKGs is possible. In order to eliminate false positives and false negatives from the set of 805 putative HKG genes in the Hela cell dataset that overlapped with one or two of the published HKG sets, and to further classify and predict HKGs within the Hela cell dataset, we established classification models using the 234 probes for standard HKGs that were common to all three datasets as the positive set for the SVM classification prediction model, and randomly selected 234 probes from the 31,335 non-HKG probes as the negative set. After a single round of prediction, the genes which were classified as HKGs were determined by the identity of the genes contained in the randomly selected negative set, i.e. there was stochastic bias. This bias can be eliminated with a bootstrap approach, i.e. genes classified as HKGs were those which had the highest counts after repeated rounds of model selection and classification. We performed computer simulations using the same method to test whether this method can reliably distinguish different kinds of time series. The simulation details and results are shown in part 4 of Text S1. The simulation results demonstrated that our method can identify different frequency patterns. Figure 6 shows the distribution of counts obtained after 4096 (212) rounds of classification. The proportion of probes that had high counts in the set of putative HKGs that overlapped with one or two of the published HKG sets, was much greater than the proportion of possible non-HKGs, once again showing the validity of frequency features. 299 genes from the 805 putative HKG genes were selected as HKGs in this way, using 3328 counts as the minimum cut-off point for selection (81.25% ballot). 53 genes from the non-HKG set were also selected since each of them was counted as an HKG more than 4085 times (99.73% ballot). Figure 7 and Figure 8 each shows the detailed distribution of counts for probes with more than 3000 and 4000 counts. All 158 standard HKGs common to the three published HKG datasets were selected as HKGs. In total our method predicted 510 HKGs. See Table S1 for detailed gene lists.
Validation and evaluation of HKG prediction results
Our prediction results were evaluated against two sets of tissue expression profiles [13], [14] which were not used in the prediction. These profiles each contained 79 and 36 different tissues. The distribution of the coefficient of variation (CV i.e. SD/mean), a measure of whether a given gene is highly expressed across all tissues and can therefore be considered as an HKG, is shown in Figure 9 and Figure 10 for all the genes in the three published HKG datasets and the 510 predicted HKGs. A comparison of the CVs for our predicted HKGs and all the 15,261 genes in the tissue expression profiles that overlapped with the Hela cell gene expression dataset is shown in Figure S2. CVs of the predicted HKGs tended to be small, suggesting that CV is an appropriate parameter for evaluating HKGs [19].
The median CVs of the two tissue expression profiles are shown in Table 1. The median CV of our predicted set of HKGs is smaller than that of the three published HKG sets, indicating that the genes in our predicted HKG set showed less fluctuation.
Table 1. Median CVs.
Median of CV | Eisenberg et. al | Hsiao et. al | Warrington et. al | Predicted HKGs |
GSE2361 [13] | 0.0785 | 0.0763 | 0.0730 | 0.0720 |
GSE1133 [14] | 0.1462 | 0.1489 | 0.1582 | 0.1462 |
Our predicted set of HKGs has a smaller median CV than that of the three published HKG sets.
Gene Ontology Analysis
We performed a gene ontology analysis to classify the predicted HKGs on the basis of their function (Figure 11). Genes in our predicted HKG set were distributed in several important biological process functional classes including cellular processes, metabolic processes and biological regulation. These terms represent the basal functions that HKGs are responsible for.
Gene Conservation Analysis
Figure 12 shows the conservation of different gene sets among 28 species [17]. Genes in all three HKG sets and our predicted HKG set tended to be more conserved than non-HKG genes from the hg18 gene table. The conservation scores of the three HKG sets and our predicted set of HKGs were similar.
Discussion
Features of HKGs
HKGs and non-HKGs differ in several statistical quantities such as CG content and SSR density. However, these features are parameters posteriorly-derived from statistical induction, and are therefore not suitable for use in quantitative classification. Such statistical induction is naturally incomplete because sampling processes have unavoidable limitations which tend to result in the choice of different collections of samples being used to address the same problem, and thus in sharply different conclusions. For example, Zhu et al. (2008), and Eisenberg and Levanon have quite different, even opposite, opinions about whether the ESTs of HKGs are compact. Thus, with respect to classification, it is not appropriate to use these statistical quantities as features of high significance and consistency. Classification using our HKG definition and Fourier analysis avoids the use of parameters based on statistical hypotheses. Results from such classifications can be verified by other statistical measures such as differences in tissue expression levels, which are independent of statistical learning and modeling, making the classification more rational.
Some research has shown that expression levels of housekeeping genes may vary depending on experimental conditions [20]. However, unless the cell state is severely disturbed by environmental conditions in the experiments, the most conceivable consequence of this disruption would be uniform upregulation (or downregulation), or gradual increase or decrease in the expression of some genes over the entire length of the experiment. This type of experimental variation will be eliminated by normalization of the data or by pre-processing to remove non-periodic trends. The algorithm used here will be reliable as long as the expression of HKG genes is steady and does not show periodic expression under specific experimental conditions. In other words, the Fourier spectra of two gene expression time-series which seem quite different may be similar, unless they have very different frequency components.
Different spectral methods
Fourier analysis is an approach which takes advantage of pattern recognition to remove noise from microarray data. A requirement of the DFT method used here is that the data from time series should be steady. The Fourier series expansion is a mathematical description of the physical fact that every linear periodic phenomenon can be expressed by a series of simple harmonic modes. The Fourier coefficient is the weighted mean over the whole time domain, i.e. Fourier analysis shows the properties of an entire time series, instead of being restricted to a small segment. So it is only asymptotic to describe the partial features of time series with it.
Several studies have already extract frequency features from expression time series of cell cycle data using Fourier analysis. The frequency features were further analyzed by functional clustering methods and genes were classified according to different expression patterns across the stages in the cell cycle [21], [22], [23]. de Lichtenberg. et al. [24] constructed an interacting network of cell cycle related proteins by combination of frequency features with physical interacting data. The clustering methods in these works mainly used the most significant frequency components as features. Rustici et al. [23] selected genes with significant power spectrum peaks which were consistent with cell cycle duration. Kim et al. [22] used three main frequency components of Fourier series for clustering, omitting other components. However, housekeeping genes are not related to the cell cycle, and have no dominanting frequencies. We therefore considered all 24 frequency components in our classification. Since SVM is good at distinguishing fuzzy patterns, it is a suitable tool for this type of dichotomy problem. The simulation showed that SVM could recognize various frequency patterns (Text S1 part 4). Our work indicated that housekeeping genes, which are not related to cell cycle, could also be identified from cell cycle data through frequency analysis. However, Cell cycle data are not necessary in the recognization of HKG. We chose these data because they contained the longest available expression time series.
Instant Fourier analysis and wavelet analysis, which consider both time and frequency, can deal with frequencies changing over time. Kim et al. [25] reported a gene clustering work based on wavelet analysis. In fact, when the time series are long enough, wavelet analysis has advantages over traditional Fourier transform for time dependent, non-stationary signals. As the accuracy of microarray data improves and the size of datasets constantly increases, instant Fourier analysis and wavelet analysis will be more often used in biochip data analyses. Using instant Fourier analysis and wavelet analysis, local features within a time series can be identified, such as the response of gene expression to regulating and controlling factors.
The selection of the threshold
We picked two distinct thresholds for the selection of putative HKG and non-HKG sets. We reasoned that genes in the putative HKG set of the three published datasets are more likely to be HKGs, while those in the non-HKG set are less likely to be HKGs, and thus chose a relatively loose threshold (3328 counts) for genes in the putative HKG set. In fact, a stricter threshold would make the CV of the selected set smaller, but more false negatives would result. We set a much stricter threshold for the non-HKG set (4085 counts), since the relative proportion of suspect HKGs was much greater than that of non-HKGs from about 4085 counts (Figure 8).
Validation of our predictions via gene function
Some genes from the putative HKG set were rejected by our procedure. For example, TUBB3 was annotated as an HKG in the Eisenberg set, but in fact it is a microtubule element expressed exclusively in neurons, commonly used to identify neurons in nervous tissue. The score for TUBB3 with our prediction method was 2287, below the HKG threshold. In the same way, TUBB scored 0 and was also below the HKG threshold. ILF2 encodes a 45 kDa subunit of NFAT (nuclear factor of activated T-cells), a transcription factor required for T-cell expression of the interleukin 2 gene that is probably only expressed in T-cells and may not be an HKG. CES2 (carboxylesterase 2), expressed in the intestine and liver, is a major intestinal enzyme and functions in intestine drug clearance. It is tissue-specific rather than housekeeping, and was also rejected by our method.
On the other hand, in the non-HKG set, ATG9A scored 4093 and was selected as an HKG. Yamada et al. [26] reported that it is ubiquitously expressed in human adult tissues. The CAPN1 gene which encodes the large subunit of a ubiquitous enzyme, calpain 1, scored 4096 in our study and was also selected as an HKG. UBE2B (score: 4091), the ubiquitin-conjugating enzyme E2B which is required for post-replicative DNA damage repair, is 100% identical to its mouse, rat, and rabbit homologs. UBE2K from the non-HKG set also scored highly (score: 4089) in our procedure. It belongs to the ubiquitin-conjugating enzyme family, too.
Here we have proposed an HKG prediction method using spectral analysis of gene expression time-series data. Our method has proved effectual and we have predicted 510 HKGs using Hela cell cycle data, including 54 genes not present in previously reported HKG sets. Our predicted HKG set was then validated using two independent tissue expression profiles. This method will be further verified when more time series data providing in-depth coverage of a sufficiently long time period become available.
Supporting Information
Acknowledgments
We are grateful to Dr. Joy Fleming for critical discussions and for editing the English of this manuscript.
Footnotes
Competing Interests: The authors have declared that no competing interests exist.
Funding: This work was supported by the National Key Basic Research and Development Program (973) under Grant Nos. 2009CB825401 and 2007CB946901, National Sciences Foundation of China under Grant Nos. 30630040. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Bolstad BM, Irizarry RA, Astrand M, Speed TP. A comparison of normalization methods for high density oligonucleotide array data based on variance and bias. Bioinformatics. 2003;19:185–193. doi: 10.1093/bioinformatics/19.2.185. [DOI] [PubMed] [Google Scholar]
- 2.Warrington JA, Nair A, Mahadevappa M, Tsyganskaya M. Comparison of human adult and fetal expression and identification of 535 housekeeping/maintenance genes. Physiol Genomics. 2000;2:143–147. doi: 10.1152/physiolgenomics.2000.2.3.143. [DOI] [PubMed] [Google Scholar]
- 3.Hsiao LL, Dangond F, Yoshida T, Hong R, Jensen RV, et al. A compendium of gene expression in normal human tissues. Physiol Genomics. 2001;7:97–104. doi: 10.1152/physiolgenomics.00040.2001. [DOI] [PubMed] [Google Scholar]
- 4.Eisenberg E, Levanon EY. Human housekeeping genes are compact. Trends Genet. 2003;19:362–365. doi: 10.1016/S0168-9525(03)00140-9. [DOI] [PubMed] [Google Scholar]
- 5.Vinogradov AE. Compactness of human housekeeping genes: selection for economy or genomic design? Trends Genet. 2004;20:248–253. doi: 10.1016/j.tig.2004.03.006. [DOI] [PubMed] [Google Scholar]
- 6.Zhu J, He F, Hu S, Yu J. On the nature of human housekeeping genes. Trends Genet. 2008;24:481–484. doi: 10.1016/j.tig.2008.08.004. [DOI] [PubMed] [Google Scholar]
- 7.Lawson MJ, Zhang L. Housekeeping and tissue-specific genes differ in simple sequence repeats in the 5′-UTR region. Gene. 2008;407:54–62. doi: 10.1016/j.gene.2007.09.017. [DOI] [PubMed] [Google Scholar]
- 8.Eller CD, Regelson M, Merriman B, Nelson S, Horvath S, et al. Repetitive sequence environment distinguishes housekeeping genes. Gene. 2007;390:153–165. doi: 10.1016/j.gene.2006.09.018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Vinogradov AE. Isochores and tissue-specificity. Nucleic Acids Res. 2003;31:5212–5220. doi: 10.1093/nar/gkg699. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.W.S.Wei W. 2005. Time Series Analysis: Univariate and Multivariate Methods (2nd Edition): Addison Wesley.
- 11.Whitfield ML, Zheng LX, Baldwin A, Ohta T, Hurt MM, et al. Stem-loop binding protein, the protein that binds the 3′ end of histone mRNA, is cell cycle regulated by both translational and posttranslational mechanisms. Mol Cell Biol. 2000;20:4188–4198. doi: 10.1128/mcb.20.12.4188-4198.2000. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Whitfield ML, Sherlock G, Saldanha AJ, Murray JI, Ball CA, et al. Identification of genes periodically expressed in the human cell cycle and their expression in tumors. Mol Biol Cell. 2002;13:1977–2000. doi: 10.1091/mbc.02-02-0030.. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Ge X, Yamamoto S, Tsutsumi S, Midorikawa Y, Ihara S, et al. Interpreting expression profiles of cancers by genome-wide survey of breadth of expression in normal tissues. Genomics. 2005;86:127–141. doi: 10.1016/j.ygeno.2005.04.008. [DOI] [PubMed] [Google Scholar]
- 14.Su AI, Wiltshire T, Batalov S, Lapp H, Ching KA, et al. A gene atlas of the mouse and human protein-encoding transcriptomes. Proc Natl Acad Sci U S A. 2004;101:6062–6067. doi: 10.1073/pnas.0400782101. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, et al. Gene ontology: tool for the unification of biology. The Gene Ontology Consortium. Nat Genet. 2000;25:25–29. doi: 10.1038/75556. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Ye J, Fang L, Zheng H, Zhang Y, Chen J, et al. WEGO: a web tool for plotting GO annotations. Nucleic Acids Res. 2006;34:W293–297. doi: 10.1093/nar/gkl031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Pollard KS, Hubisz MJ, Rosenbloom KR, Siepel A. Detection of nonneutral substitution rates on mammalian phylogenies. Genome Res. 2010;20:110–121. doi: 10.1101/gr.097857.109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Karolchik D, Hinrichs AS, Furey TS, Roskin KM, Sugnet CW, et al. The UCSC Table Browser data retrieval tool. Nucleic Acids Res. 2004;32:D493–496. doi: 10.1093/nar/gkh103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.de Jonge HJ, Fehrmann RS, de Bont ES, Hofstra RM, Gerbens F, et al. Evidence based selection of housekeeping genes. PLoS One. 2007;2:e898. doi: 10.1371/journal.pone.0000898. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Greer S, Honeywell R, Geletu M, Arulanandam R, Raptis L. Housekeeping genes; expression levels may change with density of cultured cells. J Immunol Methods. 2010;355:76–79. doi: 10.1016/j.jim.2010.02.006. [DOI] [PubMed] [Google Scholar]
- 21.Breeden LL. Periodic transcription: a cycle within a cycle. Curr Biol. 2003;13:R31–38. doi: 10.1016/s0960-9822(02)01386-6. [DOI] [PubMed] [Google Scholar]
- 22.Kim BR, Zhang L, Berg A, Fan J, Wu R. A computational approach to the functional clustering of periodic gene-expression profiles. Genetics. 2008;180:821–834. doi: 10.1534/genetics.108.093690. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Rustici G, Mata J, Kivinen K, Lio P, Penkett CJ, et al. Periodic gene expression program of the fission yeast cell cycle. Nat Genet. 2004;36:809–817. doi: 10.1038/ng1377. [DOI] [PubMed] [Google Scholar]
- 24.de Lichtenberg U, Jensen LJ, Brunak S, Bork P. Dynamic complex formation during the yeast cell cycle. Science. 2005;307:724–727. doi: 10.1126/science.1105103. [DOI] [PubMed] [Google Scholar]
- 25.Kim BR, McMurry T, Zhao W, Wu R, Berg A. Wavelet-based functional clustering for patterns of high-dimensional dynamic gene expression. J Comput Biol. 2010;17:1067–1080. doi: 10.1089/cmb.2009.0270. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Yamada T, Carson AR, Caniggia I, Umebayashi K, Yoshimori T, et al. Endothelial nitric-oxide synthase antisense (NOS3AS) gene encodes an autophagy-related protein (APG9-like2) highly expressed in trophoblast. J Biol Chem. 2005;280:18283–18290. doi: 10.1074/jbc.M413957200. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.