Abstract
Background
The main goal of our study was to investigate the implementation, prospects, and limits of marker imputation for quantitative genetic studies contrasting map-independent and map-dependent algorithms. We used a diversity panel consisting of 372 European elite wheat (Triticum aestivum L.) varieties, which had been genotyped with SNP arrays, and performed intensive simulation studies.
Results
Our results clearly showed that imputation accuracy was substantially higher for map-dependent compared to map-independent methods. The accuracy of marker imputation depended strongly on the linkage disequilibrium between the markers in the reference panel and the markers to be imputed. For the decay of linkage disequilibrium present in European wheat, we concluded that around 45,000 markers are needed for low cost, low-density marker profiling. This will facilitate high imputation accuracy, also for rare alleles. Genomic selection and diversity studies profited only marginally from imputing missing values. In contrast, the power of association mapping increased substantially when missing values were imputed.
Conclusions
Imputing missing values is especially of interest for an economic implementation of association mapping in breeding populations.
Electronic supplementary material
The online version of this article (doi:10.1186/s12864-015-1366-y) contains supplementary material, which is available to authorized users.
Keywords: Elite wheat, Map-dependent imputation, Map-independent imputation, Intensive simulation, genomic selection, Association mapping
Background
Imputing missing values is crucial for molecular marker data sets generated by methods with inherent high levels of missing data, for example genotyping-by-sequencing (GBS) [1]. This also holds for approaches aiming to reduce genotyping expenses by combining high-density marker profiling of a population subsample with medium-density marker profiling for the majority of population members. Accurate imputation is important for maximizing the power of detecting causal polymorphisms underlying complex traits [2,3].
Imputation algorithms can be classified into map-dependent and map-independent algorithms. Map-dependent methods impute missing values utilizing available linkage information [2]. In contrast, map-independent algorithms do not use the linear order of markers [1,4]. The accuracy of missing value imputation is expected to be lower for map-independent algorithms in comparison to map-dependent ones which exploit additional information. The magnitude of such differences in accuracy, however, is not known. Despite their lower expected accuracy, map-independent algorithms are relevant for species for which dense and high-quality genetic or physical maps are absent.
Several factors can influence the accuracy of imputing missing values for particular markers [5]. Increasing reference population size enhances imputation accuracy [6-8]. The accuracy of imputation benefits also if genotypic information is available for markers tightly linked to those being imputed [5,8]. In addition, allele frequency impacts the imputation of missing sites, with lower expected imputation accuracy for rare variants [5,8]. The interplay between population size, allele frequency, and linkage disequilibrium, however, has not yet been examined in detail despite the potential interactions of these factors.
Imputed molecular marker data are often used for population genetic and quantitative genetic studies [1,3,4]. The impact of imputation accuracy on diversity analyses has been investigated by analyzing GBS data from rice, maize, and wheat with a map-independent algorithm [4]. The findings revealed that estimating heterozygosity, inbreeding coefficients, and genetic differentiation were substantially biased when missing values were imputed. The effect of imputing missing values in GBS data for the purpose of genomic selection has been examined empirically in maize, wheat, and barley [1]. The prediction accuracy of genomic selection increased if missing values were imputed in contrast to a scenario excluding the missing marker data. The power to detect quantitative trait loci (QTL) increased in genome-wide association mapping studies in human and animal populations if missing values were imputed [9,10]. Analyzing the linkage disequilibrium between true and imputed SNPs in barley additionally supported the idea that QTL detection may be improved by marker imputation in plant populations [5]. Nevertheless, in-depth studies determining the impact of imputing missing values on the power of genome-wide association mapping in plants are still lacking.
Here, we draw upon published data derived from a diversity panel consisting of 372 European wheat varieties [11]. All lines had been genotyped with 9 k [12] and 90 k SNP arrays [13], which allowed us to simulate low to high marker density and GBS-like imputation scenarios. The main goal of our study was to investigate the implementation, prospects, and limits of marker data imputation for quantitative genetic studies. In particular, we (1) contrasted the imputation accuracy of one map-independent and three map-dependent algorithms under varying reference population sizes, (2) studied the influence of linkage disequilibrium and minor allele frequency on imputation accuracy, and (3) investigated the effect of imputation on the precision of diversity studies, the accuracy of genomic selection, and on the power of QTL detection in genome-wide association mapping.
Methods
Datasets
We used genotypic information based on previously published 90 k SNP array data from 372 European wheat varieties [14]. In addition, we used information on marker positions of SNPs which were present on a previously published 9 k SNP array [14]. Two of the included lines did not differ with respect to their 9 k SNP array profile. Hence, one of them, variety Exotic according to [14] was excluded from analysis. After performing quality checks to exclude those markers that were monomorphic and for which genetic map information was unavailable [15], 9,926 SNPs remained for the 90 k SNP array and 1,573 SNPs remained for the 9 k SNP array (from here on referred to as the original 90 k SNP and original 9 k SNP marker data sets, respectively).
Imputation scenarios
We randomly divided the 371 individual lines into a reference and a test population in order to evaluate the effects of low to high marker density imputation. We assumed that the reference population was fingerprinted with the 90 k SNP array and the test population only with the 9 k SNP array (Additional file 1: Figure S1). Marker data for the 8,353 SNPs present in the 90 k but not in the 9 k SNP marker data sets were treated as missing values for lines from the test population, and represented the targets for imputation. We assumed different reference population sizes of 50, 100, 200, and 300 out of 371 lines. The sampling for each reference population size was repeated 10 times in order to reduce random error [1,8]. Data sets generated in this way are referred to as low to high marker density data in the following.
We also implemented imputation on randomly excluded empirical data for mimicking GBS-derived marker data. For each line within the population of 371 lines, the 90 k SNP array marker data were randomly masked with the four missing value levels of 72.8%, 61.5%, 38.8%, and 16.1%. These four levels correspond to the missing data rates for the four scales of low to high marker density imputation with 50, 100, 200, and 300 out of 371 lines in the reference population (Additional file 1: Figure S1). The resulting randomly depleted data sets are here forth referred to as GBS-like marker data.
Imputation approaches
We used three map-dependent imputation algorithms which have been widely used in animal and plant genetics (Beagle v3.3.2 [16], FImpute v2.2 [17], and IMPUTE2 v2.3.0 [18]). In addition, we applied one map-independent algorithm (Random Forest regression). Random Forest regression had performed best among 5 map-independent methods according to a recent study [1].
The Beagle algorithm [16] exploits hidden Markov models (HMM) to infer haplotypes of individual lines and to impute missing values. First, data completion is initialized by imputing the missing values based upon allele frequencies with random phasing of the haplotypes of the individual lines. The initial data set is then used to build localized haplotype-cluster models, which represent a special class of HMM. Each model proceeds along a chromosome and has the same number of levels as the number of markers. At each level, the hidden states are the clusters of haplotypes [19]. The emitted symbols are the alleles. A forward-backward algorithm [20] is applied to estimate the probabilities of each possible haplotype based on the genotype information. Then, new haplotypes for the individuals are sampled according to the conditional probabilities as input for the next iteration. The procedure is repeated until the final iteration, where the Viterbi algorithm [20] is applied to infer the most-likely haplotypes for all individuals. Thus, the missing data points are imputed simultaneously in this step.
The FImpute population-based algorithm [17] is based on a haplotype-matching process which assumes that all individuals in the population are related. Sliding windows are used to search for consistent haplotype segments assuming that each imputed individual has a recent common ancestor within the reference population. The initial window size is large and moves along each chromosome in steps with a certain overlap. Then, the window size is steadily reduced as the procedure is repeated. Finally, the most likely haplotype is determined for each individual line based on the frequency of haplotypes in the reference population. Moreover, the number of hits from the window analysis is computed and the missing data points are imputed.
The IMPUTE2 algorithm [18] is an enhanced version of the IMPUTE1 algorithm [21] and is based on HMM and Markov chain Monte Carlo (MCMC) iterations. It differs from Beagle mainly in two points. First, it separates the procedures of inferring haplotypes and imputing missing genotypes. Second, it divides the data into (1) markers with information present in both the reference and the test set (the T part), and (2) markers with information present only in the reference set (“untyped”, the U part). Beagle in contrast builds a joint model for all individual lines at all loci. The algorithm IMPUTE2 starts by guessing the haplotypes in the T part and then performs a number of MCMC iterations. The first step in each iteration involves the loci of the T part. For each individual line, new haplotype pairs are sampled based on the probability derived from the genotype and the currently estimated haplotypes of all other individual lines, in addition to a scale parameter. In the second step, missing alleles in the U part are then imputed based on the probability derived from the results of the calculation in the first step.
The Random Forest algorithm is an advanced machine learning approach [22,23]. Molecular markers are first sorted from the lowest to highest missing data levels. Then, the missing values are initialized through a simple imputation method (e.g. sampling based on allele frequencies) and the Random Forest regression model is fitted and iterated. For each marker vector y containing missing values, 100 regression trees are grown using the non-missing values via bootstrapping. At each node in each tree, a random sample of predictors, that is, other markers at the same row of the missing part of y, is used as splitting variables, where n refers to the number of markers. The terminal node of each tree gives a prediction of the missing part of y. Then, the means of predictions obtained in all regression trees are taken as the imputed values. The above steps are repeated until convergence or 10 times at maximum.
Imputation accuracy
We used the correlation (cor) between true and imputed marker profiles as the parameter to estimate imputation accuracy. This metric is recommended because it efficiently measures the imputation accuracy for rare variation [8] and is related to the power of detection of genome-wide association scans [24]. Missing data points in the original data set, which are not caused by masking, were excluded from the evaluation.
Factors affecting the imputation accuracy
We used the r2 statistic [25] as a measure of linkage disequilibrium (LD) and examined the association between imputation accuracy and maximum LD between the imputed and observed markers. The values of r2 were estimated as r2 = (p(AB) − p(A)p(B))/(p(A)p(a)p(B)p(b)), where p(AB) is the frequency of haplotype AB and p(A), p(a), p(B), p(b) is the allele frequencies of two bi-allele loci. Furthermore, we studied the association between minor allele frequency (MAF) and imputation accuracy.
Effect of imputation on the estimation of Rogers’ distance
We studied the effects of imputation on estimating Rogers’ distances among pairs of genotypes (RD, [26,27]). RD was used as genetic distance measure because it is linearly related to the coefficient of co-ancestry for homozygous lines [28,29] and was estimated as
where pij and qij are allele frequencies of the j th allele at the i th locus in the two individuals under consideration, ni is the number of alleles at the i th locus, and m refers to the number of loci. For the low to high marker density imputation scenario, we first calculated the correlation between the RD matrices estimated by the original 90 k and original 9 k SNP marker data as a benchmark. We then estimated the correlations between RD matrices based on different imputed low to high density marker data sets and the original 90 k SNP marker data. Here, the comparison was exclusively based on imputed markers in data for the lines from the test population in order to focus solely on the accuracy of imputed marker values. Significance of the correlations between RD matrices was tested according to a Mantel test [30].
Since there exist no markers without missing values in the GBS-like marker data sets generated by random depletion, we instead first estimated RD matrices among pairs of genotypes based on the genotypic profiles by omitting for each pair of lines markers with missing values. We then calculated the correlation between non-imputed RD matrices and the RD matrices estimated using the original 90 k SNP marker data. We subsequently estimated the correlations between RD matrices based on different imputed GBS-like marker data sets and the original 90 k SNP marker data. Here, the comparison was based on individual lines from the total population comprising 371 genotypes.
Effect of imputation on genomic selection
We performed simulations to study the effect of imputation on the prediction accuracy of genomic selection. Heritability was assumed to be 0.91. Every marker was set to contribute equally (i.e., ) to the total genetic variance in order to mimic a genetic architecture typical for complex traits such as grain yield. To investigate the effects of imputation accuracy on genomic selection, we calculated accuracies of prediction using imputed low to high marker density data sets derived from the four different imputation algorithms, four different reference population scales, and ten technical replications. For low to high marker density imputation, the results were then compared with the accuracies of prediction by ridge regression best linear unbiased prediction (RR-BLUP) [31] using the original 9 k and original 90 k SNP data sets. For the GBS-like scenario, we estimated the genomic relatedness matrix of the total population based on the randomly depleted 90 k SNP data sets without imputation, and then used the genomic best linear unbiased prediction (GBLUP) model to predict genotypic values as outlined in detail elsewhere [32]. The accuracies of prediction of GBLUP were compared to those calculated based on the different imputed marker data panels. It is important to note that GBLUP and RR-BLUP are equivalent [33] but GBLUP facilitates a more proper handling of missing data for the GBS-like scenario.
Effect of imputation on genome-wide association scans
We further performed a simulation study to investigate the effect of imputation on genome-wide association mapping. Heritability was set again to 0.91. Simulation was performed assuming one QTL explaining 10% of the genetic variance for which a perfect marker was available in the 90 k, but not in the 9 k SNP array. The remaining 9,925 markers were assumed to contribute equally (i.e., ) to the remaining genetic variance. The MAF of the QTL was chosen to be larger than 0.3.
For low to high marker density imputation, we selected SNPs with different levels of LD (around 0.1, 0.5 and 0.9) between the QTL and the most closely linked markers in the 9 k SNP data set. We compared the detection frequencies of QTLs in the following 3 scenarios: (1) in the total population fingerprinted with the original 90 k SNP marker data, (2) in the reference population fingerprinted with the original 90 k SNP array, and (3) in the total panel of 371 lines for which non-available 90 k SNP marker data had been imputed. In addition, the detection frequencies of the most closely linked SNP markers present in the 9 k data set from the total population was included in the comparison.
For the GBS-like imputation scenario, also three levels of LD were considered. Here, LD was measured between the QTL and the most closely linked markers in the original 90 k SNP data set. We compared the detection frequencies of the QTL in the following 3 scenarios: (1) in the total population fingerprinted with the original 90 k SNP marker data set, (2) in the assumed available genotypic profiles of the total population of 371 lines irrespective of imputation, and (3) in the total panel for which non-available 90 k SNP array data had been imputed by three imputation approaches.
Genome-wide association mapping was performed based on a linear mixed model approach [34]. The model can be described as y = μ + αm + Xg + e, where y is the vector of simulated trait values for each genotype, μ is the vector of common intercept terms, m is the effect of the marker being tested, α denotes the vector of scores of the marker, g is the vector of genotype effects with the corresponding design matrix X and e is a residual term. The marker effect was assumed to be fixed, while all other effects were assumed to be random. Correction for population stratification was done by assuming , where K is a kinship matrix estimated as 1 minus the RD and σG2 is the genotypic variance estimated by a maximum likelihood (REML) approach. Significance of marker-trait associations was tested based on the Wald-F statistic.
Results
Accuracy of imputing missing values with map-dependent and independent algorithms
The accuracy of imputing missing values was quantified for different algorithms by estimating the correlation between the original high density 90 k SNP marker profiles and the imputed marker profiles (Additional file 1: Figure S1). In this scenario, the markers for which missing values were imputed were the ones included in the 90 k SNP but not in the 9 k SNP array. The map-dependent methods Beagle, FImpute, and IMPUTE2 led to higher imputation accuracies than the map-independent method Random Forest (Table 1). Imputation accuracy benefited from increasing the size of the reference population. Nevertheless, even for the smallest reference population size of 50 out of 371, the average correlation between true and imputed marker profiles amounted up to 0.74 for IMPUTE2.
Table 1.
Algorithm | Ref 50* | Ref 100* | Ref 200* | Ref 300* |
---|---|---|---|---|
cor | cor | cor | cor | |
Low to high marker density | ||||
Beagle | 0.61 | 0.70 | 0.75 | 0.78 |
FImpute | 0.68 | 0.73 | 0.77 | 0.80 |
IMPUTE2 | 0.74 | 0.77 | 0.81 | 0.84 |
Random Forest | 0.56 | 0.61 | 0.66 | 0.69 |
Genotyping-by-sequencing-like | ||||
Beagle | 0.76 | 0.85 | 0.92 | 0.95 |
FImpute | 0.59 | 0.79 | 0.91 | 0.95 |
IMPUTE2 | 0.68 | 0.82 | 0.91 | 0.95 |
Random Forest | 0.54 | 0.64 | 0.75 | 0.83 |
Map- dependent (Beagle, FImpute, and IMPUTE2) and map-independent (Random Forest) algorithms were applied with reference population sizes of 50, 100, 200, and 300 lines out of 371, and imputing was performed for a low to high marker density and for a GBS-like data scenario.
*For GBS-like imputation scenarios, Ref 50, Ref 100, Ref 200, and Ref 300 refer to missing value rates 72.8%; 61.5%; 38.8%; 16.1% for all lines of the population, corresponding to scenarios with reference population sizes of 50, 100, 200, and 300, of the total of 371 lines.
We contrasted the above scenario with a scenario mimicking imputation of missing values for genotyping by sequencing (GBS)-like data sets (Table 1). Estimated values of correlations between true and imputed marker profiles for GBS-like data were consistently higher than for imputing from low to high density marker profiles. The only exceptions were results obtained with the algorithms FImpute, IMPUTE2 and Random Forest for the smallest reference population size of 50 out of 371. Interestingly, the accuracy of imputing missing values benefited from an increase in the reference population size more for the GBS-like than the low to high imputation scenario (Table 1). Furthermore, we observed different rankings among algorithms comparing the two imputation scenarios.
Imputation accuracy is influenced by linkage disequilibrium and minor allele frequency
Average LD among adjacent loci in the total population amounted to 0.52 with a standard deviation of 0.39 (Additional file 2: Figure S2). We analyzed the influence of LD and MAF on imputation accuracy with varying reference population sizes. Figure 1 summarizes the results for a reference population size of 50 out of 371 individuals for the low to high density scenario. Similar trends were observed for all other reference population sizes independent from the applied imputation scenario (data not shown).
The impact of LD on the accuracy of imputing missing values was examined separately for three different MAF classes (Figure 1). We focused on LD between SNPs from the 90 k marker data set and those from the 9 k marker data set that were most closely linked to them. The average MAF in the total population amounted to 0.13 with a standard deviation of 0.14. The imputation accuracy improved non-linearly with increasing LD between the 90 k array SNPs and most closely linked 9 k array SNP for all four applied imputation algorithms irrespective of the MAF class. The coefficient of variation for accuracy of imputing missing values decreased substantially with increasing LD for all map-dependent methods. This trend was less pronounced for the map-independent method Random Forest.
We further studied the influence of the MAF on the correlation between true and imputed marker profiles separately for four classes of LD (Additional file 3: Figure S3). Despite higher average correlations between true and imputed marker profiles for higher LD classes, we observed that the accuracy of imputing missing values increased with increasing frequencies of the minor allele irrespectively of the extent of LD. This trend was, however, by far less pronounced than the influence of LD on the accuracy of imputing missing values.
Effect of imputation accuracy on estimated landscape of relatedness
For the low to high density marker imputation scenario, we used the correlation of all pairwise Rogers’ distances (RD) based on the original 9 k in comparison to the original 90 k SNP array as benchmark. The correlation amounted to 0.95 (Table 2). This value was not reached by imputing missing values with the map-independent algorithm Random Forest. In contrast, the correlation of RD estimated based on imputed and observed marker data was 0.96 for the map-dependent algorithm IMPUTE2 even for the smallest reference population size 50 out of 371 (Table 2).
Table 2.
Data set | Ref 50 | Ref 100 | Ref 200 | Ref 300 |
---|---|---|---|---|
cor | cor | cor | cor | |
9 k panel | 0.95 | 0.95 | 0.95 | 0.95 |
Beagle | 0.83 | 0.92 | 0.95 | 0.96 |
FImpute | 0.95 | 0.96 | 0.97 | 0.97 |
IMPUTE2 | 0.96 | 0.97 | 0.98 | 0.98 |
Random Forest | 0.61 | 0.61 | 0.61 | 0.66 |
Estimates are based solely on imputed parts of data sets (90 k SNP minus 9 k SNP data) and the original 90 k SNP data set, as well as the correlation between Rogers’ distance matrices of the original 9 k and original 90 k SNP data sets. Different imputed low to high marker density data sets were generated by map- dependent (Beagle, FImpute, and IMPUTE2) and map-independent (Random Forest) imputation algorithms for reference populations of 50, 100, 200, and 300 out of 371 lines. All correlations were significantly larger than zero (P < 0.01) according to a Mantel test.
For the GBS-like imputation scenario, the correlation between RD matrices between randomly depleted 90 k SNP marker data without imputation and the original 90 k SNP data set was regarded as benchmark. For imputation with the map-independent method Random Forest, the benchmark was not reached with missing data rates of 72.8% or 61.5% (Additional file 4: Table S1). In contrast, with imputation by either of the three map-dependent methods Beagle, FImpute, and IMPUTE2, the correlation between RD estimates based on imputed and original 90 SNP data was higher than the respective benchmark for all missing data levels.
Effect of imputation on the accuracy of prediction of genomic selection
To examine the impact of imputing missing marker data on the accuracy of prediction of genomic selection, we simulated a scenario for a complex trait. We used the accuracy of prediction realized with the original 9 k and the original 90 k SNP data sets as points of reference for the low to high density marker scenario. The accuracy of prediction for the total population increased by only 7% (0.73 to 0.78) when using the full 90 k instead of the 9 k SNP marker profiles (Figure 2). The accuracy of prediction of genomic selection based on the original 9 k SNP marker data was outperformed by imputing missing values with the map-independent algorithm Random Forest only when a reference population size of 300 out of 371 individual lines was used. In contrast, the accuracy of prediction of genomic selection based on the data sets imputed with the map-dependent algorithm IMPUTE2 outperformed the accuracy of prediction of genomic selection based on the original 9 k SNP marker data even with a small reference population size of 50 out of 371 individual lines.
As a benchmark to evaluate the accuracy of genomic selection based on imputed GBS-like data sets, we used the accuracy of prediction realized with a GBLUP approach based on a kinship matrix estimated with original 90 k SNP marker data or the non-imputed marker data. The accuracy of the GBLUP approach based on the original 90 k SNP marker data amounted to 0.78 (Figure 3). Prediction accuracies of GBS-like data sets profited slightly when missing marker data were imputed (Figure 3). Applying map-dependent as well as map-independent algorithms led to higher accuracies of prediction as compared to the GBLUP across all examined scenarios with missing data rates of 72.8%, 61.5%, 38.8% and 16.1%.
Effect of imputation accuracy on power of association mapping
Finally, we approached the impact of missing data imputation on the power of association mapping in a simulation study. We assumed the presence of a QTL with a marker allele frequency above 0.3 which explained 10% of the genotypic variation. Such a QTL could be detected in more than 80% of the performed association mapping runs based on the original 90 k SNP marker data for the whole population. Replacing the original 90 k SNP marker data by imputed data starting from 9 k SNP marker profiles led to reduced QTL detection power for almost all tested reference population sizes and LD values (Figure 4). Nevertheless, imputation using the map-dependent methods increased the power of association mapping in comparison to QTL detection based on non-imputed marker profiles. This increase was more pronounced if a SNP with high LD to the QTL was covered within the 9 k SNP marker data. In comparison, imputation using the map-independent Random Forest method increased the power of QTL detection only slightly, except that a marker within the 9 k SNP data set was tightly linked to the QTL. Similar trends as for the low to high marker density imputation scenario were observed for the GBS-like scenario (Additional file 5: Figure S4).
Discussion
In crop improvement programs, molecular markers are employed for (1) studying the relationship among lines [35], (2) QTL mapping in breeding populations [36], (3) marker-assisted foreground- and background selection [37], and (4) genomic selection [38,39]. In this context, the profitability of applying molecular markers strongly depends on the marker density required to achieve the intended purpose and the costs of fingerprinting at this marker density per genotype [40]. One possible strategy to reduce the total costs of such studies encompasses fingerprinting of only a core panel of lines to full depth with a dense marker platform coupled with genotyping of the entire breeding population with less dense and low-cost marker techniques (Figure 5). Low and high density fingerprints are then combined in a second step using imputation algorithms to generate marker data sets for further analysis [2]. The main goal of our study was to investigate the implementation, prospects, and limits of marker imputation for quantitative genetic studies using experimental data collected from a representative sample of European wheat lines [14].
Imputation accuracy benefits from high-quality physical and genetic maps in wheat
Comparing the performance of different imputation approaches, we observed substantially higher correlations between true and estimated marker profiles for map-dependent than for map-independent imputation methods (Table 1). This can be explained by the use of haplotype information in the map-dependent approaches [2]. Our findings thus clearly stress the importance of the availability of high-quality physical (Beagle algorithm) and genetic maps (IMPUTE2 and FImpute algorithms) for crops in order to implement imputation (Figure 5) in plant breeding. In this light, an ordered draft sequence of the hexaploid bread wheat genome has recently been released [41]. Moreover, considerable effort has been devoted to develop dense consensus maps for wheat [12,13]. Relevant physical and genetic map information is thus becoming available in order to support molecular wheat breeding strategies involving imputation. Hence, we focus our discussion on the results generated for map-dependent methods. For minor crops without detailed map information, map-independent imputation might still seem an option. However, its clear limitations require careful consideration. For instance, the genetic relatedness among genotypes will be biased when diversity is calculated based on genomic data compiled by map-independent imputation (Table 2, Additional file 4: Table S1, [4]).
Implementation of imputation strategy in wheat
In accordance with previous findings [5,8], we observed that imputation accuracy strongly depended on LD between the markers in the reference panel and the markers to be imputed (Figure 1). In contrast, allele frequency impacted imputation accuracy only marginally if the low density panel contained markers that exhibited at least moderate levels of LD (r2 > 0.5) with the imputed markers in the high density panel (Additional file 3: Figure S3). Average r2 values of markers with distances of up to 0.5 cM amounted to only 0.32 with a 25% quantile of 0.005 in our panel of European wheat lines (Additional file 2: Figure S2). This fast LD decay in our European elite wheat panel is surprising as LD is expected to decrease substantially slower in wheat as a selfing species [42-45] in comparison to an outcrossing crop such as maize [46-48]. Taking the decay of LD and the length of the genetic map of wheat of around 4,500 cM into account [12], and focusing on the gene space only, one can estimate how many markers will be needed to be determined at minimum. For a scenario involving rare alleles, approximately 45,000 markers would be required in order to facilitate high imputation accuracy.
A previous study combining experimental data of a cattle population with computer simulations [49] suggested that an optimal composition of the reference population could increase imputation accuracy. We examined this issue in our study by inspecting the association between the diversity of the reference population measured as the average RD and the imputation accuracy. For all sizes of the reference population, we observed moderate correlations with an average value of r = 0.4. This indeed hints to the possibility to enhance the imputation accuracy via an optimal composition of the reference population. A more detailed analysis of this prospect in our current study, however, is hindered by the lack of deep genotyping information that would be required to optimize the composition of the reference population [49].
Influence of missing site structure on imputation accuracy
The distribution of missing marker data points also impacted the accuracy of imputation (Table 1). Random missing data, as applicable for our GBS-like data sets [1], facilitated higher imputation accuracy compared to blocks of missing marker data. The relative advantages or disadvantages of the diverse marker platforms available, however, depend ultimately also on many other factors such as e.g. costs per marker data point, distribution of markers, as well as potential ascertainment bias [50] that cannot be discussed in the framework of this study.
Association mapping profited most from imputation of missing values
Marker densities only marginally affect the accuracies of genomic selection for complex traits. Typically, a plateau of accuracy is reached with a few hundred markers for bi-parental populations [39,51,52] and with a couple of thousand markers for diversity panels [53,54]. Even slightly lower numbers of markers have been recommended to reliably portray genetic relationships [55]. In accordance with these findings, we observed that accuracies of prediction of genomic selection or relatedness estimation could profit only marginally from imputing missing marker data (Figures 2 and 3; Table 2; Additional file 4: Table S1).
In contrast, association mapping is strongly influenced by the marker density [56], as other than genome-wide prediction it focuses on one QTL at a time [57]. Therefore, missing marker data at a particular locus cannot be compensated by other closely linked loci, which leads to a strong impact on the power of QTL detection [58]. Consistent with this expectation, we observed that the power of association mapping strongly benefited from imputing missing marker data (Figure 4; Additional file 5: Figure S4). Consequently, for association mapping in breeding populations, substantial added value can be generated by complementing routine genotyping performed on an economic marker platform with high density genotyping of a core set of lines for subsequent data imputation. The high density marker data could for instance be generated by re-sequencing, as has been implemented for soybean [59] or maize [60].
In wheat, several relevant agronomic traits such as flowering time [61,62], plant height [63], abiotic stress tolerance [64,65], and disease resistances [66] are expected to be controlled by large effect QTL. Such a genetic architecture with large effect QTLs enables efficient marker-assisted selection. Association mapping can be considered as a promising approach to identify further functional markers in breeding populations [36]. The identified functional markers can be efficiently combined with genome-wide prediction approaches to bridge the gap between marker-assisted and genomic selection [67].
Conclusions
From the examined quantitative genetic applications, association mapping profited most from imputing missing values. Association mapping is valuable for traits controlled by large effect QTLs, which is the case for a number of the economic important traits in wheat. Consequently, routine implementation of marker imputation provides a powerful tool for marker-assisted wheat improvement.
Acknowledgments
The genotyping data were generated within the frames of the projects GABI-Wheat and VALID (project numbers 0315067 and 0315947, respectively) funded within the Plant Biotechnology program of the German Federal Ministry of Education and Research (BMBF). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Abbreviations
- GBS
Genotyping-by-sequencing
- QTL
Quantitative trait locus
- SNP
Single nucleotide polymorphism
- HMM
Hidden Markov models
- MCMC
Markov chain Monte Carlo
- Cor
Correlation
- LD
Linkage disequilibrium
- MAF
Minor allele frequency
- RD
Rogers’ distances
- RR-BLUP
Ridge regression best linear unbiased prediction
- GBLUP
Genomic best linear unbiased prediction
- REML
Restricted maximum likelihood
- cM
Centimorgan
Additional files
Footnotes
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
Conceived and designed the experiments: SH, YJ, YZ, and JCR. Analyzed the data: SH. Contributed reagents/ materials/analysis tools: RB, EE. Wrote the paper: SH, YJ, YZ, MFM, TFS, and JCR. All authors read and approved the final manuscript.
Contributor Information
Sang He, Email: sang@ipk-gatersleben.de.
Yusheng Zhao, Email: zhao@ipk-gatersleben.de.
M Florian Mette, Email: mette@ipk-gatersleben.de.
Reiner Bothe, Email: Reiner.Bothe@kws.com.
Erhard Ebmeyer, Email: ebmeyer@kws-lochow.de.
Timothy F Sharbel, Email: sharbel@ipk-gatersleben.de.
Jochen C Reif, Email: reif@ipk-gatersleben.de.
Yong Jiang, Email: jiang@ipk-gatersleben.de.
References
- 1.Rutkoski JE, Poland J, Jannink J-L, Sorrells ME. Imputation of unordered markers and the impact on genomic selection accuracy. G3-GENES GENOM GENET. 2013;3:427–39. doi: 10.1534/g3.112.005363. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Li Y, Willer C, Sanna S, Abecasis G. Genotype imputation. Annu Rev Genomics Hum Genet. 2009;10:387. doi: 10.1146/annurev.genom.9.081307.164242. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Marchini J, Howie B. Genotype imputation for genome-wide association studies. Nat Rev Genet. 2010;11:499–511. doi: 10.1038/nrg2796. [DOI] [PubMed] [Google Scholar]
- 4.Fu Y-B. Genetic Diversity Analysis of Highly Incomplete SNP Genotype Data with Imputations: An Empirical Assessment. G3-GENES GENOM GENET. 2014;4:891–900. doi: 10.1534/g3.114.010942. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Iwata H, Jannink J-L. Marker genotype imputation in a low-marker-density panel with a high-marker-density reference panel: accuracy evaluation in barley breeding lines. Crop Sci. 2010;50:1269–78. doi: 10.2135/cropsci2009.08.0434. [DOI] [Google Scholar]
- 6.Boichard D, Chung H, Dassonneville R, David X, Eggen A, Fritz S, et al. Design of a bovine low-density SNP array optimized for imputation. PLoS One. 2012;7:e34130. doi: 10.1371/journal.pone.0034130. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Segelke D, Chen J, Liu Z, Reinhardt F, Thaller G, Reents R. Reliability of genomic prediction for German Holsteins using imputed genotypes from low-density chips. J Dairy Sci. 2012;95:5403–11. doi: 10.3168/jds.2012-5466. [DOI] [PubMed] [Google Scholar]
- 8.Hickey JM, Crossa J, Babu R, de los Campos G. Factors affecting the accuracy of genotype imputation in populations from several maize breeding programs. Crop Sci. 2012;52:654–63. doi: 10.2135/cropsci2011.07.0358. [DOI] [Google Scholar]
- 9.Li Y, Willer CJ, Ding J, Scheet P, Abecasis GR. MaCH: using sequence and genotype data to estimate haplotypes and unobserved genotypes. Genet Epidemiol. 2010;34:816–34. doi: 10.1002/gepi.20533. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Santana MH, Utsunomiya YT, Neves HH, Gomes RC, Garcia JF, Fukumasu H, et al. Genome-wide association analysis of feed intake and residual feed intake in Nellore cattle. BMC Genet. 2014;15:21. doi: 10.1186/1471-2156-15-21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Zanke C, Ling J, Plieske J, Kollers S, Ebmeyer E, Korzun V, et al. Genetic architecture of main effect QTL for heading date in European winter wheat. Front Plant Sci. 2014;5:217. doi: 10.3389/fpls.2014.00217. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Cavanagh CR, Chao S, Wang S, Huang BE, Stephen S, Kiani S, et al. Genome-wide comparative diversity uncovers multiple targets of selection for improvement in hexaploid wheat landraces and cultivars. Proc Natl Acad Sci. 2013;110:8057–62. doi: 10.1073/pnas.1217133110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Wang S, Wong D, Forrest K, Allen A, Chao S, Huang BE, et al. Characterization of polyploid wheat genomic diversity using a high‐density 90 000 single nucleotide polymorphism array. Plant Biotechnol J. 2014;12:787–96. doi: 10.1111/pbi.12183. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Kollers S, Rodemann B, Ling J, Korzun V, Ebmeyer E, Argillier O, et al. Whole genome association mapping of Fusarium head blight resistance in European winter wheat (Triticum aestivum L.) PLoS One. 2013;8:e57500. doi: 10.1371/journal.pone.0057500. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Albrecht T, Auinger H-J, Wimmer V, Ogutu J, Knaak C, Ouzunova M, et al. Genome-based prediction of maize hybrid performance across genetic groups, testers, locations, and years. Theor Appl Genet. 2014;127:1375–86. doi: 10.1007/s00122-014-2305-z. [DOI] [PubMed] [Google Scholar]
- 16.Browning SR, Browning BL. Rapid and accurate haplotype phasing and missing-data inference for whole-genome association studies by use of localized haplotype clustering. Am J Hum Genet. 2007;81:1084. doi: 10.1086/521987. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Sargolzaei M, Chesnais J, Schenkel F. FImpute-An efficient imputation algorithm for dairy cattle populations. J Dairy Sci. 2011;94:421. [Google Scholar]
- 18.Howie BN, Donnelly P, Marchini J. A flexible and accurate genotype imputation method for the next generation of genome-wide association studies. PLoS Genet. 2009;5:e1000529. doi: 10.1371/journal.pgen.1000529. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Browning SR. Multilocus association mapping using variable-length Markov chains. Am J Hum Genet. 2006;78:903–13. doi: 10.1086/503876. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Rabiner L. A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE. 1989;77:257–86. doi: 10.1109/5.18626. [DOI] [Google Scholar]
- 21.Marchini J, Howie B, Myers S, McVean G, Donnelly P. A new multipoint method for genome-wide association studies by imputation of genotypes. Nat Genet. 2007;39:906–13. doi: 10.1038/ng2088. [DOI] [PubMed] [Google Scholar]
- 22.Breiman L. Random forests. Mach Learn. 2001;45:5–32. doi: 10.1023/A:1010933404324. [DOI] [Google Scholar]
- 23.Stekhoven DJ, Bühlmann P. MissForest—non-parametric missing value imputation for mixed-type data. Bioinformatics. 2012;28:112–8. doi: 10.1093/bioinformatics/btr597. [DOI] [PubMed] [Google Scholar]
- 24.Browning BL, Browning SR. A unified approach to genotype imputation and haplotype-phase inference for large data sets of trios and unrelated individuals. Am J Hum Genet. 2009;84:210–23. doi: 10.1016/j.ajhg.2009.01.005. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Zhao H, Nettleton D, Dekkers J. Evaluation of linkage disequilibrium measures between multi-allelic markers as predictors of linkage disequilibrium between single nucleotide polymorphisms. Genet Res. 2007;89:1–6. doi: 10.1017/S0016672307008634. [DOI] [PubMed] [Google Scholar]
- 26.Rogers JS. Measures of genetic similarity and genetic distance. Studies in Genetics. 1972;7:145–53. [Google Scholar]
- 27.Reif JC, Melchinger AE, Frisch M. Genetical and mathematical properties of similarity and dissimilarity coefficients applied in plant breeding and seed bank management. Crop Sci. 2005;45:1–7. doi: 10.2135/cropsci2005.0001. [DOI] [Google Scholar]
- 28.Malécot G: Mathematics of heredity. Les mathematiques de l'heredite 1948.
- 29.Melchinger A, Messmer M, Lee M, Woodman W, Lamkey K. Diversity and relationships among US maize inbreds revealed by restriction fragment length polymorphisms. Crop Sci. 1991;31:669–78. doi: 10.2135/cropsci1991.0011183X003100030025x. [DOI] [Google Scholar]
- 30.Mantel N. The detection of disease clustering and a generalized regression approach. Cancer Res. 1967;27:209–20. [PubMed] [Google Scholar]
- 31.Meuwissen THE, Hayes BJ, Goddard ME. Prediction of Total Genetic Value Using Genome-Wide Dense Marker Maps. Genetics. 2001;157:1819–29. doi: 10.1093/genetics/157.4.1819. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.VanRaden P. Efficient methods to compute genomic predictions. J Dairy Sci. 2008;91:4414–23. doi: 10.3168/jds.2007-0980. [DOI] [PubMed] [Google Scholar]
- 33.Habier D, Fernando RL, Dekkers JCM. The Impact of Genetic Relationship Information on Genome-Assisted Breeding Values. Genetics. 2007;177:2389–97. doi: 10.1534/genetics.107.081190. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Yu J, Pressoir G, Briggs WH, Bi IV, Yamasaki M, Doebley JF, et al. A unified mixed-model method for association mapping that accounts for multiple levels of relatedness. Nat Genet. 2005;38:203–8. doi: 10.1038/ng1702. [DOI] [PubMed] [Google Scholar]
- 35.Brummer EC. Capturing heterosis in forage crop cultivar development. Crop Sci. 1999;39:943–54. doi: 10.2135/cropsci1999.0011183X003900040001x. [DOI] [Google Scholar]
- 36.Würschum T. Mapping QTL for agronomic traits in breeding populations. Theor Appl Genet. 2012;125:201–10. doi: 10.1007/s00122-012-1887-6. [DOI] [PubMed] [Google Scholar]
- 37.Frisch M, Bohn M, Melchinger AE. Comparison of selection strategies for marker-assisted backcrossing of a gene. Crop Sci. 1999;39:1295–301. doi: 10.2135/cropsci1999.3951295x. [DOI] [Google Scholar]
- 38.Heffner EL, Sorrells ME, Jannink J-L. Genomic selection for crop improvement. Crop Sci. 2009;49:1–12. doi: 10.2135/cropsci2008.08.0512. [DOI] [Google Scholar]
- 39.Zhao Y, Zeng J, Fernando R, Reif JC. Genomic prediction of hybrid wheat performance. Crop Sci. 2013;53:802–10. doi: 10.2135/cropsci2012.08.0463. [DOI] [Google Scholar]
- 40.Riedelsheimer C, Melchinger AE. Optimizing the allocation of resources for genomic selection in one breeding cycle. Theor Appl Genet. 2013;126:2835–48. doi: 10.1007/s00122-013-2175-9. [DOI] [PubMed] [Google Scholar]
- 41.Mayer KF, Rogers J, Doležel J, Pozniak C, Eversole K, Feuillet C, et al. A chromosome-based draft sequence of the hexaploid bread wheat (Triticum aestivum) genome. Science. 2014;345:1251788. doi: 10.1126/science.1251788. [DOI] [PubMed] [Google Scholar]
- 42.Chao S, Dubcovsky J, Dvorak J, Luo M-C, Baenziger SP, Matnyazov R, et al. Population-and genome-specific patterns of linkage disequilibrium and SNP variation in spring and winter wheat (Triticum aestivum L.) BMC Genomics. 2010;11:727. doi: 10.1186/1471-2164-11-727. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Hao C, Wang L, Ge H, Dong Y, Zhang X. Genetic diversity and linkage disequilibrium in Chinese bread wheat (Triticum aestivum L.) revealed by SSR markers. PLoS One. 2011;6:e17279. doi: 10.1371/journal.pone.0017279. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Reif JC, Maurer HP, Korzun V, Ebmeyer E, Miedaner T, Würschum T. Mapping QTLs with main and epistatic effects underlying grain yield and heading time in soft winter wheat. Theor Appl Genet. 2011;123:283–92. doi: 10.1007/s00122-011-1583-y. [DOI] [PubMed] [Google Scholar]
- 45.Würschum T, Langer SM, Longin CFH, Korzun V, Akhunov E, Ebmeyer E, et al. Population structure, genetic diversity and linkage disequilibrium in elite winter wheat assessed with SNP and SSR markers. Theor Appl Genet. 2013;126:1477–86. doi: 10.1007/s00122-013-2065-1. [DOI] [PubMed] [Google Scholar]
- 46.Remington DL, Thornsberry JM, Matsuoka Y, Wilson LM, Whitt SR, Doebley J, et al. Structure of linkage disequilibrium and phenotypic associations in the maize genome. Proc Natl Acad Sci. 2001;98:11479–84. doi: 10.1073/pnas.201394398. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Flint-Garcia SA, Thornsberry JMB., IV Structure of Linkage Disequilibrium in Plants*. Annu Rev Plant Biol. 2003;54:357–74. doi: 10.1146/annurev.arplant.54.031902.134907. [DOI] [PubMed] [Google Scholar]
- 48.Van Inghelandt D, Reif JC, Dhillon BS, Flament P, Melchinger AE. Extent and genome-wide distribution of linkage disequilibrium in commercial maize germplasm. Theor Appl Genet. 2011;123:11–20. doi: 10.1007/s00122-011-1562-3. [DOI] [PubMed] [Google Scholar]
- 49.Druet T, Macleod IM, Hayes BJ. Toward genomic prediction from whole-genome sequence data: impact of sequencing design on genotype imputation and accuracy of predictions. Heredity. 2014;112:39–47. doi: 10.1038/hdy.2013.13. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Poland JA, Brown PJ, Sorrells ME, Jannink J-L. Development of high-density genetic maps for barley and wheat using a novel two-enzyme genotyping-by-sequencing approach. PLoS One. 2012;7:e32253. doi: 10.1371/journal.pone.0032253. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Lorenzana RE, Bernardo R. Accuracy of genotypic value predictions for marker-based selection in biparental plant populations. Theor Appl Genet. 2009;120:151–61. doi: 10.1007/s00122-009-1166-3. [DOI] [PubMed] [Google Scholar]
- 52.Zhao Y, Gowda M, Liu W, Würschum T, Maurer HP, Longin FH, et al. Accuracy of genomic selection in European maize elite breeding populations. Theor Appl Genet. 2012;124:769–76. doi: 10.1007/s00122-011-1745-y. [DOI] [PubMed] [Google Scholar]
- 53.Technow F, Riedelsheimer C, Schrag TA, Melchinger AE. Genomic prediction of hybrid performance in maize with models incorporating dominance and population specific marker effects. Theor Appl Genet. 2012;125:1181–94. doi: 10.1007/s00122-012-1905-8. [DOI] [PubMed] [Google Scholar]
- 54.Crossa J, Pérez P, Hickey J, Burgueño J, Ornella L, Cerón-Rojas J, et al. Genomic prediction in CIMMYT maize and wheat breeding programs. Heredity. 2014;112:48–60. doi: 10.1038/hdy.2013.16. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Yu J, Zhang Z, Zhu C, Tabanao DA, Pressoir G, Tuinstra MR, et al. Simulation appraisal of the adequacy of number of background markers for relationship estimation in association mapping. The Plant Genome. 2009;2:63–77. doi: 10.3835/plantgenome2008.09.0009. [DOI] [Google Scholar]
- 56.Morris GP, Ramu P, Deshpande SP, Hash CT, Shah T, Upadhyaya HD, et al. Population genomic and genome-wide association studies of agroclimatic traits in sorghum. Proc Natl Acad Sci. 2013;110:453–8. doi: 10.1073/pnas.1215985110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Bernardo R, Yu J. Prospects for genomewide selection for quantitative traits in maize. Crop Sci. 2007;47:1082–90. doi: 10.2135/cropsci2006.11.0690. [DOI] [Google Scholar]
- 58.Rincent R, Moreau L, Monod H, Kuhn E, Melchinger AE, Malvar RA, et al. Recovering Power in Association Mapping Panels with Variable Levels of Linkage Disequilibrium. Genetics. 2014;197:375–87. doi: 10.1534/genetics.113.159731. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Li Y, Zhao S, Ma J, Li D, Yan L, Li J, et al. Molecular footprints of domestication and improvement in soybean revealed by whole genome re-sequencing. BMC Genomics. 2013;14:579. doi: 10.1186/1471-2164-14-579. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.Jiao Y, Zhao H, Ren L, Song W, Zeng B, Guo J, et al. Genome-wide genetic changes during modern breeding of maize. Nat Genet. 2012;44:812–5. doi: 10.1038/ng.2312. [DOI] [PubMed] [Google Scholar]
- 61.Distelfeld A, Li C, Dubcovsky J. Regulation of flowering in temperate cereals. Curr Opin Plant Biol. 2009;12:178–84. doi: 10.1016/j.pbi.2008.12.010. [DOI] [PubMed] [Google Scholar]
- 62.Griffiths S, Simmonds J, Leverington M, Wang Y, Fish L, Sayers L, et al. Meta-QTL analysis of the genetic control of ear emergence in elite European winter wheat germplasm. Theor Appl Genet. 2009;119:383–95. doi: 10.1007/s00122-009-1046-x. [DOI] [PubMed] [Google Scholar]
- 63.Peng J, Richards DE, Hartley NM, Murphy GP, Devos KM, Flintham JE, et al. ‘Green revolution’genes encode mutant gibberellin response modulators. Nature. 1999;400:256–61. doi: 10.1038/22307. [DOI] [PubMed] [Google Scholar]
- 64.Zhu J, Pearce S, Burke A, See DR, Skinner DZ, Dubcovsky J, et al. Copy number and haplotype variation at the VRN-A1 and central FR-A2 loci are associated with frost tolerance in hexaploid wheat. Theor Appl Genet. 2014;127:1183–97. doi: 10.1007/s00122-014-2290-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.Zhao Y, Gowda M, Würschum T, Longin CFH, Korzun V, Kollers S, et al. Dissecting the genetic architecture of frost tolerance in Central European winter wheat. J Exp Bot. 2013;64:4453–60. doi: 10.1093/jxb/ert259. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Saintenac C, Zhang W, Salcedo A, Rouse MN, Trick HN, Akhunov E, et al. Identification of wheat gene Sr35 that confers resistance to Ug99 stem rust race group. Science. 2013;341:783–6. doi: 10.1126/science.1239022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Zhao Y, Mette M, Gowda M, Longin C, Reif J. Bridging the gap between marker-assisted and genomic selection of heading time and plant height in hybrid wheat. Heredity. 2014;112:638–45. doi: 10.1038/hdy.2014.1. [DOI] [PMC free article] [PubMed] [Google Scholar]