Abstract
Background
Accurate prediction of genomic breeding values (GEBVs) requires numerous markers. However, predictive accuracy can be enhanced by excluding markers with no effects or with inconsistent effects among crosses that can adversely affect the prediction of GEBVs.
Methods
We present three different approaches for pre-selecting markers prior to predicting GEBVs using four different BLUP methods, including ridge regression and three spatial models. Performances of the models were evaluated using 5-fold cross-validation.
Results and conclusions
Ridge regression and the spatial models gave essentially similar fits. Pre-selecting markers was evidently beneficial since excluding markers with inconsistent effects among crosses increased the correlation between GEBVs and true breeding values of the non-phenotyped individuals from 0.607 (using all markers) to 0.625 (using pre-selected markers). Moreover, extension of the ridge regression model to allow for heterogeneous variances between the most significant subset and the complementary subset of pre-selected markers increased predictive accuracy (from 0.625 to 0.648) for the simulated dataset for the QTL-MAS 2010 workshop.
Background
Genomic selection (GS) is a method for predicting breeding values on the basis of a large number of molecular markers [1]. However, if many markers actually have zero effects but are estimated to be non-zero, then their cumulative effects increase noise in the estimates [2]. Thus, markers are most useful for GS if they are in high linkage disequilibrium with a QTL. Many authors pre-screen markers before including them in GS (e.g. [3,4]). If a marker is in high linkage disequilibrium with a QTL its effect should be consistent among crosses (full sib families) or generations. One option therefore is to select against markers with inconsistent effects.
We compare different methods for selecting the most relevant markers for GS. Genomic breeding values (GEBVs) were estimated using different BLUP methods and number of pre-selected markers. Besides ridge regression (RR), spatial models were also used. The best model was selected using cross-validation (CV).
Methods
Data
A simulated dataset of 3226 individuals in five generations generated for the QTL-MAS 2010 workshop was analysed. A total of 2326 individuals belonging to the first four generations were phenotyped and genotyped with 10031 SNP markers. Moreover, 900 individuals in the fifth generation were genotyped but had no phenotypic records. We focus here only on the quantitative trait. A SNP was included in the analysis only if its minor allele frequency exceeded 2.5%. This resulted in the exclusion of 461 SNPs.
The marker covariate zik for the i-th individual (i = 1, 2,…, G) and the k-th marker (k= 1, 2,…, M) for biallelic SNP markers with alleles A1 and A2 was set to 1 for A1A1, -1 for A2A2 and 0 for A1A2. Covariates were stored in a matrix Z = {zik}.
Pre-selection of SNPs
We tested the effect of each SNP on the quantitative trait using three different methods.
Method 1
Each SNP was tested using a linear regression, like in Macciotta et al. [4], given by
yi = μ + ukzik + ei,
where yi is the phenotypic record for the i-th individual, μ is the intercept, zik is the genotype of the i-th individual for the k-th marker, uk is the slope of the linear regression on the k-th marker and ei is the residual error .
Method 2
Each SNP was analysed for consistency among crosses using the model
yic = μ + ukzik + Crossc + γckzik + eic,
where Crossc is the random effect of the c-th cross and γck is the slope of the random linear regression of the c-th cross on the k-th marker. The variance-covariance structure for the random regression was assumed to be unstructured and bivariate-normal (BVN), i.e. , where Σ is an unstructured 2×2 variance-covariance matrix. The random interaction effect (γck) served as the error term for the test of the SNP main effect (uk). If the SNP main effect is highly consistent, the interaction will be small, and so the F-value will be relatively large. Conversely, if the SNP is inconsistent, the main effect will be small and the interaction large, yielding small F-values.
Method 3
Each SNP was analysed for consistency among generations using the model
yig = μ + ukzik + Generationg + γgkzik + eig,
where Generationg is the random effect of the g-th generation and γgk is the slope of the random linear regression of the g-th generation on the k-th marker. Similarly to method 2, the SNP main effect (uk) is tested against the random interaction term (γgk).
The n (n = 500, 1000, 2000, 3000) most significant markers (i.e. those with the smallest p-values) were included in the GS model.
GEBVs estimation
The genotypic effect was estimated using the following linear mixed model:
yi = μ + gi + ei,
where yi is the phenotypic record for the i-th individual, μ is the intercept, gi is the genotypic effect of the i-th individual, and e is a random residual .
The genotypic value (g) was predicted by regression on the maker types:
where zik is the regressor variable for the i-th genotype and k-th marker, while uk are the regression coefficients. It was assumed that the regression coefficients are independent random draws from a common normal distribution,
This model was extended to incorporate heterogeneous variances between the a (a = 5, 10, 50, 100, 250) most significant markers and the remaining n-a (n = 500, 1000, 2000, 3000) pre-selected markers, similar to model MIXTURE in [5]. The extended model is
where m=1 denotes the a most significant and m=2 the remaining n-a pre-selected markers.
The regression coefficients were predicted by best linear unbiased prediction (BLUP) and the variance components estimated by restricted maximum likelihood (REML). For each fitted model we obtained BLUPs for μ + gi corresponding to GEBVs.
Spatial models
We considered different models for the variance of g′ = (g1,g2,…,gG), conditionally on the markers Z = {zik}, where G is the number of genotypes. All conditional models were of the form for some matrix Γ that is a function of Z and is a variance component. The models that were used are identical to those used in [6,7]. The genetic correlation under the spatial models is expressed as Γ = {f(dii′)}, where dii′ is the Euclidean distance of genotypes i and i′, defined as dii′ = ||zi – zi′||, with equal to the i-th row of Z, and f(d) is some monotonically decreasing function of d. Some examples of the function f(d) are shown in Figure 1 and in [8]. The quadratic model is equivalent to RR [6]. A semivariogram based on genetic Euclidean distances computed from SNP data can be used to inspect the fit of different models for GS. Hence we used the Cressie-Hawkins robust semivariogram estimator [9].
Cross-validation
A 5-fold cross-validation (CV) was performed to evaluate model performance. All phenotyped individuals were included in the CV, except those in the first generation. Overall 75 crosses (full sib families) were included. The dataset was randomly split into 5 subsamples each of which contained 15 crosses. In each CV round the phenotypic records for one of the five subsamples was held out and used as a validation set. Each subsample was held out and used as a validation set only once.
The mean Pearson correlations between the GEBVs and observed values in the 5 replicates of the validation sets and between the true breeding values (TBVs) of the non-phenotyped individuals of the fifth generation and GEBVs were used as measures of accuracy.
All mixed models were fitted using the REML method in the SAS MIXED procedure and the theoretical semivariograms in the SAS NLIN procedure.
Results
A high correlation was established between the semivariance and the genetic distance between pairs of individuals (Fig. 1), suggesting that it is reasonable to model the genetic covariance between pairs of individuals. However, RR and the spatial models gave essentially similar fits (Table 1).
Table 1.
Ridge Regression | Gaussian | Exponential | Linear | |||||
---|---|---|---|---|---|---|---|---|
n | CV | TBV | CV | TBV | CV | TBV | CV | TBV |
9570 | 0.530 | 0.607 | 0.530 | 0.600 | 0.530 | 0.607 | Did not converge | |
500 | 0.570 | 0.599 | 0.569 | 0.596 | 0.572 | 0.599 | 0.572 | 0.596 |
1000 | 0.583 | 0.623 | 0.583 | 0.614 | 0.583 | 0.620 | 0.584 | 0.614 |
2000 | 0.579 | 0.625 | 0.580 | 0.614 | 0.582 | 0.621 | 0.582 | 0.614 |
3000 | 0.576 | 0.617 | 0.577 | 0.608 | 0.580 | 0.615 | 0.580 | 0.608 |
Pre-selection of markers was evidently beneficial, with methods 1 and 2 achieving similar predictive accuracies and outperforming method 3 (Fig. 2). Method 2 was somewhat better supported than method 1. Comparisons of the GEBVs to the TBVs suggested that it was preferable to pre-select 1000 or 2000 markers for all models, confirming the results of the CV (Table 1).
Moreover, the extended model with heterogeneous variances between lowly and highly significant markers increased accuracy (Table 2).
Table 2.
Combination | Pearson correlation | ||
---|---|---|---|
n | a | CV | TBV |
1000 | 0 | 0.583 | 0.623 |
1000 | 5 | 0.582 | 0.625 |
1000 | 10 | 0.586 | 0.632 |
1000 | 50 | 0.587 | 0.635 |
1000 | 100 | 0.586 | 0.637 |
1000 | 250 | 0.584 | 0.630 |
2000 | 0 | 0.579 | 0.625 |
2000 | 5 | 0.580 | 0.628 |
2000 | 10 | 0.588 | 0.640 |
2000 | 50 | 0.589 | 0.645 |
2000 | 100 | 0.590 | 0.648 |
2000 | 250 | 0.588 | 0.640 |
Overall, RR with 2000 markers selected by method 2 and allowing for heterogeneous variances among the 100 most significant and the remaining 1900 markers gave the most accurate prediction of GEBVs for the fifth generation.
Discussion
We have evaluated how pre-selection of markers influences predictive accuracy in GS using RR and its spatial extensions via genetic distances. The spatial models differed in terms of the theoretical models used to model the empirical semivariogram among the genotypes as a function of their genetic distances of separation. All the fitted theoretical semivariogram models were remarkably similar within the range of the observed semivariogram values, and so were their predictions. This suggests that further study is needed to decide if modelling genetic covariances using non-linear spatial models is beneficial compared to RR, especially for non-additive genetic effects.
Our results reinforce findings of other studies suggesting that pre-selecting markers may enhance predictive accuracy [3]. For example, the results of a BLUP model [4] using pre-selected markers were better supported than those of BLUP methods that used all markers [10]. However, pre-selecting markers may not always increase accuracy and may sometimes even reduce it [11].
The extended model with two variance components for the markers increased predictive accuracy because it better approximated the simulated genetic model with a few QTLs with different variances. Heterogeneous variance models may, however, not always exhibit superior performance. In particular, simulating many QTLs with small effects may lower the performance of models allowing for heterogeneous variances among individual markers [5].
Conclusions
Pre-selection of markers was beneficial and increased predictive accuracy from 0.607 to 0.625. Partitioning markers into two groups with heterogeneous variances further increased accuracy up to 0.648 for the simulated dataset.
Competing interests
The authors declare no competing interests.
Authors' contributions
TSS participated in the design of the study, performed all analyses and drafted the manuscript. JOO helped draft the manuscript and interpret the results. HPP conceived the study, participated in its design, and helped in the final editing of the manuscript.
Contributor Information
Torben Schulz-Streeck, Email: torben.schulz-streeck@uni-hohenheim.de.
Joseph O Ogutu, Email: jogutu2007@gmail.com.
Hans-Peter Piepho, Email: piepho@uni-hohenheim.de.
Acknowledgements
We are thankful to the reviewers for constructive comments. This research was funded by AgReliant Genetics and the German Federal Ministry of Education and Research (BMBF) within the AgroClustEr “Synbreed – Synergistic plant and animal breeding” (Grant ID: 0315526).
This article has been published as part of BMC Proceedings Volume 5 Supplement 3, 2011: Proceedings of the 14th QTL-MAS Workshop. The full contents of the supplement are available online at http://www.biomedcentral.com/1753-6561/5?issue=S3.
References
- Meuwissen THE, Hayes BJ, Goddard ME. Prediction of total genetic value using genome-wide dense marker maps. Genetics. 2001;157:1819–1829. doi: 10.1093/genetics/157.4.1819. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Goddard ME, Hayes BJ. Genomic selection. Journal of Animal Breeding and Genetics. 2007;124:323–330. doi: 10.1111/j.1439-0388.2007.00702.x. [DOI] [PubMed] [Google Scholar]
- Hayes BJ, Bowman PJ, Chamberlain AJ, Goddard ME. Genomic selection in dairy cattle: Progress and challenges. J Dairy Sci. 2009;92:433–443. doi: 10.3168/jds.2008-1646. [DOI] [PubMed] [Google Scholar]
- Macciotta NPP, Gaspa G, Steri R, Pieramati C, Carnier P, Dimauro C. Pre-selection of most significant SNPS for the estimation of genomic breeding values. BMC Proc. 2009;3(Suppl 1) doi: 10.1186/1753-6561-3-s1-s14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Meuwissen THE. Accuracy of breeding values of 'unrelated' individuals predicted by dense SNP genotyping. Genet Sel Evol. 2009;41(35) doi: 10.1186/1297-9686-41-35. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Piepho HP. Ridge regression and extensions for genome-wide selection in maize. Crop Science. 2009;49:1165–1176. doi: 10.2135/cropsci2008.10.0595. [DOI] [Google Scholar]
- Schulz-Streeck T, Piepho HP. Genome-wide selection by mixed model ridge regression and extensions based on geostatistical models. BMC Proc. 2010;4(Suppl 1):S8. doi: 10.1186/1753-6561-4-S1-S8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Schabenberger O, Gotway CA. Statistical methods for spatial data analysis. Boca Raton: CRC Press; 2005. [Google Scholar]
- Cressie NAC, Hawkins DM. Robust estimation of the variogram. Mathematical Geology. 1980;12:115–125. doi: 10.1007/BF01035243. [DOI] [Google Scholar]
- Lund MS, Sahana G, de Koning D-J, Su G, Carlborg Ö. Comparison of analyses of the QTLMAS XII common dataset. I: Genomic selection. BMC Proc. 2009;3(Suppl 1):S1. doi: 10.1186/1753-6561-3-s1-s1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Weigel KA, de los Campos G, González-Recio O, Naya H, Wu XL, Long N, Rosa GJ, Gianola D. Predictive ability of direct genomic values for lifetime net merit of Holstein sires using selected subsets of single nucleotide polymorphism markers. J Dairy Sci. 2009;92:5248–5257. doi: 10.3168/jds.2009-2092. [DOI] [PubMed] [Google Scholar]