Skip to main content
G3: Genes | Genomes | Genetics logoLink to G3: Genes | Genomes | Genetics
. 2019 Mar 12;9(5):1557–1569. doi: 10.1534/g3.118.200994

Use of F2 Bulks in Training Sets for Genomic Prediction of Combining Ability and Hybrid Performance

Frank Technow 1,1
PMCID: PMC6505161  PMID: 30862623

Abstract

Developing training sets for genomic prediction in hybrid crops requires producing hybrid seed for a large number of entries. In autogamous crop species (e.g., wheat, rice, rapeseed, cotton) this requires elaborate hybridization systems to prevent self-pollination and presents a significant impediment to the implementation of hybrid breeding in general and genomic selection in particular. An alternative to F1 hybrids are bulks of F2 seed from selfed F1 plants (F1:2). Seed production for F1:2 bulks requires no hybridization system because the number of F1 plants needed for producing enough F1:2 seed for multi-environment testing can be generated by hand-pollination. This study evaluated the suitability of F1:2 bulks for use in training sets for genomic prediction of F1 level general combining ability and hybrid performance, under different degrees of divergence between heterotic groups and modes of gene action, using quantitative genetic theory and simulation of a genomic prediction experiment. The simulation, backed by theory, showed that F1:2 training sets are expected to have a lower prediction accuracy relative to F1 training sets, particularly when heterotic groups have strongly diverged. The accuracy penalty, however, was only modest and mostly because of a lower heritability, rather than because of a difference in F1 and F1:2 genetic values. It is concluded that resorting to F1:2 bulks is, in theory at least, a promising approach to remove the significant complication of a hybridization system from the breeding process.

Keywords: F2 bulks, hybridization systems, genomic prediction, hybrid breeding, GenPred, Shared Data Resources


Since the pioneering work of Shull (1908), hybrid breeding made a significant contribution to increased productivity of globally important field (Duvick 1999) and horticultural (da Silva Dias 2010) crops. The development of hybrid varieties rests on the ability to evaluate general combining ability (GCA) of parental inbred lines in earlier stages of the breeding cycle, as well as specific combining ability (SCA), or hybrid performance in general, of particular combinations in stages leading up to release and commercialization (Sprague and Tatum 1942).

Genomic prediction methodology (Meuwissen et al. 2001) has successfully been applied to prediction of GCA (Albrecht et al. 2011; Würschum et al. 2013; Jan et al. 2016) and hybrid performance (Massman et al. 2013; Technow et al. 2014a). This has greatly increased the scale, speed and accuracy of breeding operations (Cooper et al. 2014) and promises an increased rate of genetic gain (Heffner et al. 2010; Gaynor et al. 2017). Building accurate genomic prediction models requires training data sets of hundreds or even thousands of phenotyped and genotyped individuals (Jannink et al. 2010; Lorenz 2013; Hickey et al. 2014) which can put enormous strain on resources. Promising approaches for increasing the efficiency and throughput of phenotyping (Araus and Cairns 2014; Tardieu et al. 2017) and genotyping (Poland and Rife 2012; Gorjanc et al. 2017; Technow and Gerke 2017) are currently being developed.

However, producing high-quality F1 testcross seed in sufficient quantities for multi-environment field trials can be an enormous challenge when done for hundreds or even thousands of training individuals. This is the case particularly for autogamous species with hermaphrodite flowers, a group that includes important field crops such as wheat (Triticum aestivum), rapeseed (Brassica napus), cotton (Gossypium hirsutum), sugar beet (Beta vulgaris), rice (Oryza sativa), and sunflower (Helianthus annuus), as well as many horticultural species. Here, hybrid seed production requires elaborate hybridization systems (Kempe and Gils 2011; Whitford et al. 2013) that add considerable complexity and cost to the breeding process (da Silva Dias 2010; Longin et al. 2015). For example, cytoplasmic male sterility (CMS), one of the most widely used hybridization systems (Janick 1998; Kempe and Gils 2011; Bohra et al. 2016; Kim and Zhang 2018), requires (1) development of sterile versions of inbreds (“A-lines”) from the female heterotic pool by backcrossing them into a sterile cytoplasm source, (2) retaining of fertile versions of the same inbreds for seed multiplication (“B-lines”) and (3) introgression of effective fertility restoration genes into the male inbred lines. The complexity and costs arising from applying this and similar systems to hundreds or thousands of individuals for training set development might be prohibitive, particularly when those individuals were chosen with regard to maximum informativeness for model building (Rincent et al. 2012) but have no breeding purpose as selection candidates otherwise.

One possible solution for making large scale production of testcross hybrid seed more feasible is to field test bulks of selfed F1 seed (F1:2), instead of the F1 hybrids directly. There are examples of commercial use of F2 hybrid seed in cases where F1 hybrid seed production is not economically feasible (Janick 1998; Wu et al. 2004; Bosland 2005). This option has also been considered for application of classical mating designs such as Designs I and II (Comstock and Robinson 1948, 1952) to autogamous species (Stuber 1970). The idea is to test bulked F2 seed from selfed F1 plants obtained by hand pollination (Figure 1). In this system, the seed is produced from vigorous F1 plants instead of inbred lines and according to the natural mode of fertilization (at least for autogamous species). Only very few F1 plants would therefore be required for producing sufficient seed quantities for multi-environment testing and those could easily be produced by hand-pollination, without requiring any form of pollination control such as CMS. Using F1:2 bulks instead of F1 hybrids could therefore be a cost efficient option for producing testcross seed for the hundreds or thousands of individuals comprising training sets in genomic prediction. Under non-additive gene action, however, F1 and F1:2 performance are expected to differ. Using predictions obtained from F1:2 based training sets could then negatively impact genetic gain at the F1 level, which remains the selection target. The objective of this study is therefore to evaluate the prospects of using F1:2 bulks for genomic prediction of F1 hybrid and GCA performance with quantitative genetic theory and stochastic simulation of a genomic prediction experiment.

Figure 1.

Figure 1

Schematic visualization of creation of F1:2 bulks of F1 interpopulation hybrids. The individual steps are (1) making a F1 cross between a male and a female inbred line by hand pollination (2) selfing the resulting F1 plant (3) creating F1:2 bulks by harvesting the seed from each selfed F1 plant and bulking it.

Materials and Methods

Theory

Assume a heterotic pattern formed by two populations (“heterotic groups”), arbitrarily labeled “male” (Πm) and “female” (Πf). The members of both populations are fully homozygous inbred lines, either produced as doubled haploids (DH), the method of choice in many crop species (Dwivedi et al. 2015), or by repeated selfing to a degree that residual heterozygosity is negligible. Consider further two biallelic, independent loci in linkage equilibrium, with alleles B1 and B2 and C1 and C2, respectively. A superscript m or f will be used to indicate the origin of the allele (e.g., B1f when the allele B1 originates from Πf). The alleles are assumed identical in state (i.e., biological function) in both populations (e.g., B1m is identical in state with B1f). Let pB1m and pC1m and pB1f and pC1f denote the frequencies of the B1m and C1m alleles in Πm and of the B1f and C1f alleles in Πf, respectively. The frequencies of the alternate alleles are, for example, pB2m=1pB1m. Allele frequencies might differ in Πm and Πf.

When the populations Πm and Πf are intermated strictly at random, the resulting set of Πm×Πf F1 hybrids forms a “gene-orthogonal population” (Schnell 1965; Melchinger et al. 2005). With two biallelic loci and alleles defined according to their origin, there are 16 distinct genotypes, indexed as HBim,Bjf,Ckm,ClfF1. For notational simplicity this will be shortened to HijklF1. In a gene-orthogonal population the genotype frequencies of HijklF1 follow from the products of the allele frequencies in Πm and Πf, e.g., the frequency of H1112F1 is pB1mpB1fpC1mpC2f. These frequencies will be denoted by Pijkl.

Selfing each member of HijklF1 and “bulking” the progeny results in a set of F1:2 bulks denoted by HijklF1:2 (i.e., the F2 seed from each F1 is bulked separately for each member of HijklF1). With alleles defined according to origin, each individual HijklF1:2 bulk comprises 16 distinct genotypes, each with genotype frequency of 1/16 when assuming absence of segregation distortion. The frequencies of the different HijklF1:2 bulks themselves are also Pijkl.

Consider a three by three matrix U with elements uxy equal to the genotypic value of the two-locus genotypes formed by the xth genotype of the ’B’ locus and the yth at the ’C’ locus. The homozygous B1B1 genotype thereby corresponds to row x=1, the heterozygous B1B2 or B2B1 genotype to x=2 and the alternate homozygous to x=3, correspondingly for the C locus (see below for examples). Because alleles are assumed to be identical in state in both populations, it is not necessary to distinguish them by origin for the purpose of describing possible genotypic values. Let GijklF1 denote the genotypic values of the members of HijklF1. The rows x and columns y of U corresponding to elements in GijklF1 are x=i+j1 and column y=k+l1.

Similarly, let GijklF1:2 denote the average genotypic values of the F1:2 bulks HijklF1:2. Those can also be obtained from U as the average genotypic value of the possible genotypes in the bulk, weighted by their frequencies, when assuming absence of segregation distortion. For this purpose, the origin of the allele is again not distinguished. For example, G2212F1:2 would equal 0.25u31+0.5u32+0.25u33.

The correlation between GijklF1 and GijklF1:2 (corhybrids), a measure for the similarity between both, was calculated according to the standard statistical definition (e.g., Mood et al. 1973), with the mean of GijklF1 being

μF1=i2j2k2l2GijklF1Pijkl

and the variance

σF12=i2j2k2l2(GijklF1)2PijklμF12

and with μF1:2 and σF1:22 obtained analogously. Thus,

corhybrids=i2j2k2l2GijklF1GijklF1:2PijklμF1μF1:2σF12σF1:22

These and all other equations developed here are implemented in a worksheet that is available as supplemental material (File S1).

The GCA of a male inbred with genotype BiCk was evaluated as

γik(F1)m=1pBimpCkmj2l2GijklF1PijklμF1

with the corresponding values for the other population and those for the F1:2 bulks (γik(F1:2)m) being defined accordingly. The correlation between γik(F1)m and γik(F1:2)m was used to assess the similarity of GCA effects evaluated in F1 hybrids and F1:2 bulks and will be denoted as corGCA(m) and corGCA(f) for Πm and Πf, respectively. These correlations were obtained analogously to corhybrids and according to their standard statistical definition (e.g., Mood et al. 1973). The variances of γik(F1)m etc., which are required for computing the correlations, will be denoted as σGCAm(F1)2 etc. Because populations Πm and Πf are intermated at random, the male and female effects are uncorrelated with each other. The variance of SCA effects can then be calculated as σSCA(F1)2=σF12σGCAm(F1)2σGCAf(F1)2, similarly for HijklF1:2.

The quantities γik(F1)m, etc., are statistical effects that depend on the allele frequencies in both populations. Thus, two members of Πm and Πf with identical genotypes will have different GCA values (e.g., γ11(F1)mγ11(F1)f), unless both populations have identical allele frequencies, even though the alleles are assumed to be identical in state in both populations (Schnell 1965; Stuber and Cockerham 1966). Therefore also corGCA(m)corGCA(f) in general. For simplicity, however, the average across both, denoted as corGCA will be used, where appropriate.

Models of genetic architecture and population structure:

Several models of gene action will be considered, all encoded through U. The first involves only additive and dominant gene action (“dominance model”), here U is

C1C1C1C2C2C2B1B1aB+aCaB+dCaBaCB1B2dB+aCdB+dCdBaCB2B2aB+aCaB+dCaBaC

where homozygous effects for the B and C locus, aB and aC, and heterozygous effects dB and dC are defined according to Falconer and Mackay (1996). A purely “additive model” follows by setting dB=dC=0. Here, however, GijklF1=GijklF1:2 in the absence of segregation distortion and so corhybrids and corGCA are equal to one. The same is the case for the “additive by additive” epistatic model without dominance or epistatic interactions involving dominance (Hill et al. 2008):

C1C1C1C2C2C2B1B12zz0B1B2zzzB2B20z2z

where z is an arbitrary constant. The “duplicate factor model” involving additive and dominant gene action as well as all forms of epistatic interactions (Hill et al. 2008) is

C1C1C1C2C2C2B1B1zzzB1B2zzzB2B2zz0

and the “complementary model”, also involving all forms of gene action (Hill et al. 2008), is

C1C1C1C2C2C2B1B1zz0B1B2zz0B2B2000

Biological interpretations and examples for the latter two models are given by Holland (2001).

For the duplicate and complementary epistasis models, the quantities corhybrids, corGCA, σF12, σF1:22 as well as the proportion of SCA to total genetic variance (%scaF1=σSCA(F1)2/σF12 and %scaF1:2=σSCA(F1:2)2/σF1:22) were evaluated across a dense grid of degree of allele frequency differences between Πm and Πf for the B and C locus. This difference will henceforth be referred to as “allele divergence” and defined as the difference between, e.g., pB1m and pB1f, with the midpoint being 0.5. Thus, at a divergence of 0.20, pB1m=0.6 and pB1f=0.4, for example. For both models, z=1 was used. Only one locus was considered for the dominance model (i.e., aC=dC=0) and in addition to the allele divergence, the degree of dominance was varied from 0.0 to 3.0 (the homozygous effect was kept constant at aB=1).

Simulation of genomic prediction experiments

A comprehensive simulation of genomic prediction experiments was carried out to evaluate the accuracy of genomic models fitted from training data sets of F1 hybrids and F1:2 bulks for the purpose of predicting hybrid and GCA performance at the F1 level.

Parental inbred line genomes:

The observed genotypes at 35,478 single nucleotide polymorphism (SNP) markers of 209 maize inbred lines from the Dent (123) and Flint (86) heterotic groups of the maize breeding program of the University of Hohenheim in Germany formed the starting point of the simulation. This data set is available publicly as supplemental material to a publication by Technow et al. (2014a). This data were chosen to ensure that the simulated experiments are reflective of the genome properties (allele frequency distribution, linkage pattern and population structure) of an applied hybrid breeding program. The genome properties as well as the history of these populations and the heterotic pattern they form were described in previous studies (Technow et al. 2014a,b). For consistency sake, the Dent and Flint populations will arbitrarily be referred to as “male” and “female”, respectively.

In-silico biparental populations:

Biparental families of DH lines derived from elite inbred parents are the predominant population type encountered in early stages of breeding programs (Mikel and Dudley 2006; Riedelsheimer et al. 2013; Hickey et al. 2015). In the simulation, each heterotic group was represented by 40 biparental families. The process of how those were created will be described for the male group but was followed analogously for the female group. Five of the 123 male inbred lines were assigned to the “high importance” group, twenty to the “medium importance” group and the remaining 98 to the “low importance” group. This assignment was done at random. The “high importance” inbreds were given a weight of 0.1, the “medium importance” inbreds a weight of 0.0125 and the remaining inbreds a weight of 0.00255 (the weights of all inbreds sum to 1.0). Then all (1232) possible biparental crosses among those 123 inbreds were assigned weights equal to the product of the weights of the corresponding parents. The 40 biparental families were then drawn at random from all possible families with probabilities proportional to the weights previously assigned. This results in an unbalanced contribution of inbred lines to the breeding populations and reflects that often just a few, very successful inbred lines are used disproportionately by breeders (Mikel and Dudley 2006; Technow et al. 2014b).

Then, 25 recombinant DH lines were generated in-silico from each family by simulating meiosis between the gametes of the parents followed by a chromosome doubling step. Meiosis was simulated according to the Haldane mapping function with the software package “hypred” (Technow 2013). Thus, each heterotic group comprised 1,000 DH lines from 40 biparental families. A random sample of 15,000 of the SNP markers was used for these simulations to facilitate computations. Because simulation of meiosis requires a genetic linkage map, the physical map positions of the SNP loci where rescaled linearly to the chromosome lengths of the genetic map reported by Fu et al. (2006).

Simulation of genetic architecture:

200 loci were defined to be QTL with direct influence on a generic complex trait. Those loci were chosen from the set of 15,000 SNP included in the simulation according to two population structure scenarios: “convergent” and “divergent”. In the convergent scenario, the QTL had similar allele frequencies in both heterotic groups with a maximum absolute difference of 0.05 (i.e., |pmpf|<0.05). This corresponds to a newly formed hybrid breeding program before the establishment of distinct heterotic groups (Melchinger 1999; Fischer et al. 2009). In the divergent scenario, both populations had very different allele frequencies with a minimum absolute difference of 0.60 (i.e., |pmpf|>0.60), which corresponds to a well established hybrid breeding program in which heterotic groups have diverged as a result of many cycles of reciprocal recurrent selection (Labate et al. 1999; Reif et al. 2007; Technow et al. 2014a; Larièpe et al. 2017). The definitions of the convergent and divergent heterotic group scenarios correspond to those in Technow et al. (2012). An additional requirement was that loci used as QTL had to have a minimum minor allele frequency of 0.025 in each heterotic group to ensure that they were contributing to genetic variation. Within those constraints, the 200 QTL were drawn at random.

They were then randomly separated into 100 two-loci pairs. Each pair was assigned a matrix U describing the genotypic values. On average, 5% of the loci were assigned to the additive and another 5% to the additive by additive gene action models. The dominance model was assigned to 10% of the pairs. The remaining 80% of pairs were assigned to the complementary and the duplicate factor gene action models in equal proportion. Thus, on average 90% of the QTL gave rise to non-additive gene action effects that affect F1 and F1:2 genetic values differently. Note, however, that the latter three gene action models contain all types of gene action effects, including additive and additive by additive.

The homozygous effects a (used for the additive and dominance models) were drawn from a Normal distribution with mean zero and standard deviation of 0.25/2/π (throughout, the Normal distribution will be parametrized by its mean and standard deviation). Their absolute values then have an expectation of 0.25. The heterozygosity gene effects d were drawn from N(|a|,|a|0.6084), resulting in an average degree of dominance of one, which is consistent with experimental results in hybrid crops (Gardner 1963; Radoev et al. 2008; Schön et al. 2010; Larièpe et al. 2012). Using |a|0.6084 as standard deviation ensures that 90% of the sampled heterozygosity effects are above zero. This was done because dominance effects for traits showing hybrid vigor tend to be positive (Semel et al. 2006; Bennewitz and Meuwissen 2010; Huang et al. 2015). For the additive by additive model, the value of z was drawn from N(0,0.25/2/π) and for the duplicate and complementary gene action models from N(0,1/2/π). The absolute values of z thus have expectations of 0.25 and 1.00, respectively. Those settings for the distributions of a, d, and z were chosen to ensure that the various gene action effects have the same magnitude in all gene action models. For example, with z=1, a=d=0.25 in the duplicate and complementary gene action models and hence equal to their expected values in the additive and dominance gene action models. Gene action effects for arbitrary U can be calculated with File S1 according to definitions by Holland (2001). Because interaction systems among loci can rarely be cleanly assigned to a particular model (Holland 2001), a small amount of “genetic noise” was added to the elements of each U matrix. Those values were drawn from a Normal distribution with mean zero and standard deviation equal to (1/90xy|uxy|)/2/π. The mean absolute value of those deviations was thus expected to be equal to 1/10th of the mean absolute value of the elements of a particular instance of U. All U matrices thus slightly deviated from their assigned models of gene action and as a result, even pairs assigned the simple additive model will give rise to small amounts of variation due to dominance and epistatic gene action.

In-silico population of hybrids:

The genotypic values of all F1 hybrids from the full factorial of 1,000×1,000=1,000,000 interpopulation hybrids were calculated by summing the genetic effects across all 100 two-loci pairs according to the QTL genotypes of the hybrids. Because the parents were fully homozygous DH lines, the QTL genotypes of the hybrids follow directly from the genotypes of their parents. This full factorial was defined as the reference population of hybrids. The true GCA values of all 1,000 male and 1,000 female DH lines were calculated from the row and column means of the full factorial table (Sprague and Tatum 1942). Accordingly, the true SCA effects of all hybrids were obtained as the difference between the performance of the individual hybrids and the parental GCA effects.

Genomic prediction training set:

The DH from 20 male and 20 female families, chosen at random from the 40 male and female families created, were used for building the training set. Each of the 500 DH from the 20 families from one heterotic group was paired at random with one DH from the 20 families of the opposite heterotic group, resulting in a set of 500 hybrid combinations (Figure 2). This design is similar to the reciprocal testcrossing design used by Kadam et al. (2016). The 500 male and 500 female DH lines as well as the 500 hybrid combinations among them will henceforth also be referred to as “tested”. The 500 hybrid combinations comprising the training set are a subset of the total population of hybrids and the genotypic performance values of the F1 versions were calculated as described before. Phenotypic values were obtained by adding a Gaussian noise term with standard deviation chosen in such a way that the broad sense heritability was 0.5. This training set will also be refered to as F1 training set. The alternative F1:2 training set was made up of F1:2 bulks created from the same hybrids that were used for the F1 training set. For this, each F1 was selfed in-silico and 100 F2 individuals generated by simulating meiosis as described before. The true genetic values of each of the 100 F2s was calculated similarly as for the F1s and then averaged to arrive at the genetic performance of the F1:2 bulk. Phenotypic values were generated according two scenarios. In the first, the residual variation used for the F1 training set was assumed constant (“constant residual variation” scenario), in the second a constant heritability of 0.5 was assumed also for the F1:2 estimation set by adjusting the residual variation accordingly (“constant heritability” scenario).

Figure 2.

Figure 2

Schematic visualization of reciprocal crossing design used to build the training set.

Prediction model:

The following mixed model was fitted to the data

yi=μ+αim+(αα)im+αif+(αα)if+δi+(αδ)im+(αδ)if+(δδ)i+ei

where yi is the scaled and centered phenotypic value of the ith training set entry (either a F1 hybrid or a F1:2 bulk, depending on the training set). The intercept is denoted by μ. Male and female additive main and additive by additive epistatic interaction effects are αim and (αα)im, and αif and (αα)if, respectively, which together constitute the GCA of a fully homozygous male and female parents of the ith hybrid combination (Falconer and Mackay 1996, p. 276). Dominance effects are denoted by δi, interaction effects between male and female additive and dominance effects are (αδ)im and (αδ)if, respectively, and (δδ)i denote the dominance by dominance interaction effects. Together, those effects constitute the SCA effect of the ith hybrid combination. The residual associated with yi is ei and was modeled as iid N(0,σe2). The other effects were modeled by Multivariate-Normal distributions with mean vectors of zero and covariance matrices defined as

KαmTT=(1/cαm)ATTmσαm2
K(αα)mTT=(1/c(αα)m)ATTmATTmσ(αα)m2
KαfTT=(1/cαf)ATTfσαf2
K(αα)fTT=(1/c(αα)f)ATTfATTfσ(αα)f2
KδTT=(1/cδ)ATTmATTfσδ2
K(αδ)mTT=(1/c(αδ)m)ATTmATTmATTfσ(αδ)m2
K(αδ)fTT=(1/c(αδ)f)ATTfATTfATTmσ(αδ)f2
K(δδ)TT=(1/c(δδ))ATTmATTmATTfATTfσ(δδ)2

following Stuber and Cockerham (1966), where ATTm and ATTf are the additive genomic relationship matrices of the tested male and female parents, respectively, of the training set hybrids and ’’ indicates element-wise multiplication. These matrices were calculated from the marker data following VanRaden (2008) as ATTm=WmWm/Mm, where Mm is the number of markers and wuv=(xuv2pv)/4pv(1pv) (with u indexing the parent and v the marker), xuv coding the number of reference alleles (taking values of 0 or 2), and pv being the allele frequency of the reference allele in the male population. The genomic relationship matrix of the female parents was obtained analogously. Both matrices were calculated from the same set of 5,000 marker loci, which were obtained by randomly sampling from the initial set of 15,000 loci but excluding the 200 loci defined as QTL. The terms cαm etc. are normalization factors equal to cαm=mean[diag(ATTm)], etc. and help to bring the estimated variance components onto a comparable scale with the residual variance (Xu 2013). This model is similar to the one used by Massman et al. (2013) and Technow et al. (2014a) except that these authors did not consider epistatic effects. The model was fitted using the R package ‘BGLR’ (Pérez and Campos 2014) and its default settings for prior distributions and hyperparameters. A total of 1,000 samples were obtained from a chain of length 100,000, with a burn-in of 50,000 and a thinning interval of 50. The posterior means of the variance components and of the intercept were used as point estimates.

Genomic prediction accuracy:

The performance of all F1 hybrids from the full factorial was predicted using BLUP as CPTVTT1(yμ) following Henderson (1973), where CPT is the genetic covariance matrix of predicted and tested hybrid combinations and VTT the phenotypic covariance matrix of the data. The elements of CPT and VTT were computed according to Bernardo (1996), with the addition of the covariance matrices of epistatic effects not considered there. Specifically, VTT=KαmTT+K(αα)mTT+KαfTT+K(αα)fTT+KδTT+K(αδ)mTT+K(αδ)fTT+K(δδ)TT+Iσe2. Further, CPT=KαmPT+K(αα)mPT+KαfPT+K(αα)fPT+KδPT+K(αδ)mPT+K(αδ)fPT+K(δδ)PTwith KαmPT etc., calculated analogously to the corresponding KαmTT etc. but using additive relationship matrices APTm and APTf, which represent the additive relationships of the parents of the 1,000,000 hybrid combination to be predicted and the parents of the training set hybrids. The normalization constants calculated previously were used to normalize these matrices, too. Predictions for SCA effects were obtained by limiting CPT to the covariance matrices of the effects contributing to SCA. Following Technow et al. (2012), hybrids for which both the male and the female parent were tested were assigned to the “T2” prediction set, hybrids for which either the male or the female parent were tested (but not both) were assigned to the “T1” set and hybrids without any tested parent were assigned to the “T0” set. The tested hybrids themselves were assigned to the “T3” set. Prediction accuracy of total hybrid performance and SCA effects was defined as the Pearson correlation coefficient between predicted values and the corresponding true values of the F1 hybrids. To emphasize, the true performance and SCA effects of the F1 hybrids were used as reference values also when assessing the accuracy of the model fitted from the F1:2 training set.

When predicting the GCA of DH lines, CPT=KαmPT+K(αα)mPT for males and CPT=KαfPT+K(αα)fPT for females. The matrices KαmPT etc., were computed as before but from APTm and APTf which for this purpose contained the relationships between all 1,000 male or female parents and the male or female parents of the estimation set hybrids. Prediction accuracy of GCA effects was defined as the Pearson correlation coefficient between predicted and true GCA effects obtained from the full factorial of F1 hybrids. Thus, the prediction accuracy evaluates the ability to predict F1 based GCA, even when the F1:2 training set is used. The prediction accuracy was calculated separately for tested and untested DH lines and within and across families. The within family accuracies were averaged across families. To simplify the results further, all accuracies were averaged across male and female heterotic groups.

The whole simulation was repeated independently 2,500 times for each heritability and population structure scenario and results averaged. All computations were conducted within the R statistical computing environment (R Core Team 2018).

Data Availability

The SNP genotypes of the Dent and Flint inbred lines used as the initial population and the physical map of the SNP are available from the online supplement of Technow et al. (2014a). Supplemental material available at Figshare: https://doi.org/10.25387/g3.7493996.

Results

Theoretical models

The correlation between F1 hybrids and F1:2 bulks (corhybrids) was mostly high (above 0.9) in the dominance (Figure 3A) and both epistatic models (Figures 4A and 4G). The widest range of values was thereby observed for the duplicate model, where corhybrids reached below 0.5 when allele divergence was extreme (Figure 4A). In the dominance model corhybrids decreased with increasing degree of dominance, but remained high throughout. In the complementary model it was lowest when divergence was high at both loci, but again only slightly below the highest values, which were achieved when none or only one of the loci were strongly diverged (Figure 4G). The correlation between GCA effects obtained from F1 or F1:2 (corGCA, average across male and female correlations) in the duplicate model followed a similar trend as corhybrids (Figure 4B) but remained considerably higher also under extreme divergence. In the complementary model corGCA was high and confined to a narrow range, similar to corhybrids (Figure 4H). The highest values were observed when divergence was either similar at both loci or very different. However, minimum and maximum values were only marginally different. With just a single locus, corGCA in the dominance model is either 1.0 or 0.0, depending on the combination of allele divergence and degree of dominance (Figure 3B). More specifically, corGCA=0.0 is a result of the correlation being 1.0 in the population with higher allele frequency and 1.0 in the other. Values of 1.0 are thereby observed within a narrow band defined by particular combinations of allele divergence and degree of dominance. The genetic variance of F1 hybrids (σF12) in the dominance model increased with increasing degree of dominance and decreasing divergence (Figure 3C). In the epistatic models, it decreased with increasing divergence at one or both loci (Figures 4C and 4I). Under the dominance and complementary models, the ratio σF1:22/σF12 was below one throughout, indicating that F1 hybrids are expected to have a greater genetic variance than F1:2 bulks (Figures 3D and 4J). In the duplicate model the opposite was the case, and σF1:22 could be considerably larger than σF12 when allele divergence became extreme (Figure 4D). The proportion of SCA to total genetic variance in the F1 hybrids (%scaF1) followed similar trends as the total genetic variance under all models, i.e., it decreased with increasing allele divergence and decreasing degree of dominance (Figures 3E, 4E and 4K). Finally was the ratio %scaF1:2/%scaF1 below one throughout for all three models, indicating that relatively less genetic variation can be attributed to SCA effects in F1:2 bulks than in F1 hybrids (Figures 3G, 4G and 4L).

Figure 3.

Figure 3

Expected values of corhybrids (A), corGCA(f) (B), σF12 (C), σF1:22/σF12 (D), %scaF1 (E) and %scaF1:2/%scaF1 (F) under the “dominance” model as a function of allele frequency divergence and degree of dominance. Note that the color scale is not constant across sub-figures.

Figure 4.

Figure 4

Expected values of corhybrids (A,G), corGCA (B,H), σF12 (C,I), σF1:22/σF12 (D,J), and %scaF1 (E,K) and %scaF1:2/%scaF1 (F,L) under the duplicate model (top row) and complementary model (bottom row) as a function of allele frequency divergence at both loci. Note that the color scale is not constant across sub-figures. The values in sub-figure D were transformed to ln(σF1:22/σF12) to aid visibility.

Simulation results

Quantitative genetic parameters:

Because these parameters are not affected by the heritability scenario, only results for the “constant residual variation” scenario will be shown. The F1 hybrids had a larger genetic variance than F1:2 bulks (Table 1). The difference between the two was relatively larger under the divergent heterotic group structure, where σF1:22 was less than half of σF12. Overall, genetic variance was larger in the convergent structure than in the divergent structure, for both F1 and F1:2. The proportion of SCA to total genetic variation was larger in the convergent than the divergent structure by almost 10 percentage points (Table 1). This quantity could only be assessed for the F1 hybrids for which the full factorial was created. Finally, the correlation between F1 hybrids and F1:2 bulks was largest in the convergent heterotic group structure and very close to 1.00 (Table 1). However, this correlation was with 0.91 very high in the divergent scenario, too.

Table 1. Average simulation results of total genetic variance, proportion of SCA variance and correlation between F1 hybrids and F1:2 bulks.
Convergent Divergent
F1 F1:2 F1 F1:2
Variancea 20.34 12.36 15.89 7.63
%SCAb 0.24 0.15
Correlationc 0.97 0.91
a

True genetic variance of F1 hybrids (σF12) and F1:2 bulks (σF1:22) used in the training set.

b

True proportion of SCA to total genetic variance (%scaF1) in full factorial (only measured for F1 hybrids for which full factorial was created).

c

Correlation (corhybrids) of true genetic values of F1 hybrids and F1:2 bulks in training set.

GCA prediction:

Under constant residual variation, the prediction accuracy obtained from the F1 training set was higher than that for the F1:2 training set throughout (Table 2). Under a convergent heterotic group structure, the differences were small and did not exceed 0.04 points. Differences under the divergent structure were in the magnitude of 0.10 points. When the heritability of the F1:2 bulk phenotypes was made equal to that of the F1 hybrids (constant heritability scenario), the GCA prediction accuracy from the F1:2 training set increased considerably and now was close to (divergent structure) or even slightly higher (convergent structure) than that of the F1 training set. (The heritability of the latter was 0.5 in both cases and so the accuracy values were not expected to change.) Overall, prediction accuracy was higher for DH lines that contributed to the training set (“tested”) than for DH lines that did not (“untested”) and lower within families than across.

Table 2. Average simulation results for genomic prediction accuracy of GCA effects.
Structure Generation Within family Across families
Tested Untested Tested Untested
Constant residual variationa
Convergent F1 0.49 0.34 0.71 0.51
F1:2 0.45 0.32 0.67 0.49
Divergent F1 0.50 0.36 0.73 0.54
F1:2 0.40 0.29 0.62 0.46
Constant heritabilityb
Convergent F1 0.49 0.34 0.71 0.51
F1:2 0.51 0.36 0.72 0.52
Divergent F1 0.50 0.36 0.73 0.54
F1:2 0.48 0.34 0.69 0.51
a

Phenotypic values in F1 and F1:2 training sets had same magnitude of residual variation.

b

Phenotypic values in F1 and F1:2 training sets had same heritability.

Hybrid prediction:

Under constant residual variation, the prediction of hybrid performance was more accurate when using the F1 training set than for the F1:2 training set (Table 3). The difference between the two thereby was largest for the divergent heterotic group structure, where it reached from 0.15 points for T3 hybrids to 0.06 points for T0 hybrids. Under the convergent heterotic group structure, the differences reached from 0.09 points (T3) to 0.01 points (T0). With constant heritability the accuracy of the predictions from the F1:2 training set increased markedly and now were similar (divergent structure) or even slightly higher (convergent structure) than for the F1 training set. In general, the performance of T3 hybrids was predicted with highest accuracy, followed by T2, T1 and T0 hybrids. The prediction accuracy of SCA effects was considerably lower than that of total hybrid performance throughout (Table 3). Similar trends held, however, with the exception that even under constant heritability the F1:2 training set was considerably less accurate than the F1 training set.

Table 3. Average simulation results for genomic prediction accuracy of hybrid performance and SCA effects.
Structure Generation Hybrid performance SCA effects
T3a T2 T1 T0 T3 T2 T1 T0
Constant residual variationb
Convergent F1 0.76 0.63 0.55 0.45 0.35 0.18 0.14 0.12
F1:2 0.67 0.60 0.52 0.44 0.20 0.12 0.10 0.08
Divergent F1 0.78 0.69 0.61 0.51 0.33 0.17 0.13 0.10
F1:2 0.63 0.59 0.52 0.44 0.18 0.10 0.07 0.06
Constant heritabilityc
Convergent F1 0.76 0.63 0.55 0.45 0.35 0.18 0.14 0.11
F1:2 0.74 0.64 0.56 0.46 0.25 0.14 0.11 0.09
Divergent F1 0.78 0.69 0.61 0.51 0.33 0.17 0.13 0.10
F1:2 0.72 0.65 0.57 0.48 0.24 0.12 0.10 0.07
a

T3: Hybrids used in training set (i.e., with observed data); T2: both parents represented in training set but with different partners; T1: one parent represented; T0: no parent represented.

b

Phenotypic values in F1 and F1:2 training sets had same magnitude of residual variation.

c

Phenotypic values in F1 and F1:2 training sets had same heritability.

Discussion

Using F1:2 bulks for genomic prediction training sets and more generally testcross and hybrid evaluation is an alternative when production of large quantities of seed of F1 hybrids is expensive, significantly increases the complexity of a breeding program or is impossible altogether. The objective of this study was to assess the promise of this approach from a theoretical point of view with the help of quantitative genetics theory and stochastic simulation.

Quantitative genetic properties

Both the simulation as well as the theoretical results indicate that the correlation between F1 hybrids and F1:2 bulks can be expected to be high across a wide range of scenarios (Table 1, Figures 3 and 4). A few exceptions should be pointed out, however. Lower values, particularly for corhybrids, were observed for increasing divergence between the allele frequencies in the two heterotic groups, particularly for the duplicate epistatic model (Figure 4A). Here, most of the F1 hybrids are expected to have genotypic value of z, and only a small fraction a value of zero (those homozygous for the ’2’ allele at both loci). F1:2 bulks derived from F1 hybrids heterozygous at one or both loci, however, will exhibit an average performance that is intermediate between z and 0.0. With increasing allele frequency divergence, relatively more F1 hybrids are heterozygous at one or both loci, leading to a greater frequency of cases with differing F1 and F1:2 performance and hence a lower correlation.

Two factors will lessen the impact of strongly diverged pairs of loci with duplicate gene action on the overall correlation for complex traits. First, is the genetic variance generated by loci pairs with duplicate gene action considerable lower than for pairs of loci with complementary gene action but similar divergence and magnitude of gene action effects (compare figures 4C and 4I). Second, does the generated variance decrease with increasing divergence (Figure 4C). Thus, when a trait is influenced by both duplicate and complementary epistasis and by loci with different degrees of divergence, the impact of strongly diverged loci exhibiting duplicate epistasis on the overall correlation between F1 and F1:2 genetic effects will be relatively minor.

Under dominant gene action, the correlation between F1 and F1:2 GCA effects in the heterotic group with lower frequency of the allele that increase genetic value can take values of -1 within a narrow band defined by particular combinations of allele divergence and degree of dominance (Figure 3B). An explanation for this phenomenon is provided in the supplemental file S2. For brevity it should suffice here to state that for degrees of dominance below one (i.e., partial dominance), the correlation is always +1 and that very high degrees of dominance are required to reach this “band” for low or moderate divergence of allele frequencies. As can be seen from the example in File S2 (and from File S1) as well, loci that exhibit this behavior will contribute relatively little to the variance of GCA effects in the affected heterotic group. Thus, to have an impact on the overall GCA correlation, the vast majority of loci controlling a complex trait must be within the specific combinations of allele divergence and degree of dominance defining this “band” and the alleles increasing genotypic value must consistently have a lower frequency in the same heterotic group. This seems unlikely for a complex trait controlled by hundreds or thousands of genes. The low contribution to GCA variance in the heterotic group in which corGCA is -1 also explains why corhybrids remains high even then.

The theoretical results show that to the degree that corhybrids (and corGCA) did decrease, it largely did so as a function of increasing allele divergence. This explains that corhybrids was lower in the divergent heterotic group structure, characterized by strong differences in male and female frequencies of QTL alleles, than in the convergent structure, where QTL alleles were constrained to have similar frequency in both heterotic groups.

The observation that the genetic variance is lower among F1:2 bulks than among F1 hybrids (Table 1) is also in line with the theory, which further predicts that this difference increases as allele frequencies diverge. This again is observed in the simulation results, in which the F1:2 had approximately 61% of the variation of the F1 in the convergent heterotic group structure but only about 48% in the divergent structure. Duplicate epistasis again presents somewhat of an exception, because here the F1:2 actually had a larger variance than the F1 (Figure 4D) and the more so the more the alleles diverged. As mentioned before, however, the weight of loci with duplicate epistatic effects on determining overall genetic trends for complex traits is considerably lower than that of loci with other types of gene action.

Finally, the theoretical results show that the proportion of SCA to total genetic variation in the F1 hybrids decreases with increasing interpopulation divergence for the dominance (Figure 3E), the duplicate (Figure 4E) and the complementary model (Figure 4K). This was also observed in the simulation, where the relative amount of SCA variation was almost 10 percentage points higher in the convergent than in the divergent population structure scenario. Reif et al. (2007) previously showed that increasing interpopulation divergence reduces the proportion of SCA variance when considering only dominance. For random mating populations in Hardy-Weinberg equilibrium it was further shown that genetic variance generated by the epistatic and dominance models considered here is largely additive when allele frequencies are at extreme values (Hill et al. 2008). Theoretical results also imply that the contribution of SCA to total variance is expected to be relatively lower for F1:2 bulks than F1 hybrids. This is easiest to see under dominant gene action, where d is in essence halved because only 50% of the segregants within a F1:2 bulk derived from a heterozygous F1 will have a genetic value of d and the genetic values of the homozygous segregants will cancel in the determination of the mean value of the bulk.

The theory developed here in principle applies also to QTL with large effects on the trait of interest. An exception, however, are major QTL that affect plant stature and morphology. A prime example of such QTL are “dwarfing genes” (Hedden 2003). Their segregation in the F1:2 bulks would result in uneven plant stands as well as increased plant to plant competition, which would add to the differential performance between F1 hybrids and F1:2 bulks in a way not accounted for by the theory or simulations developed here. It could also result in an increased residual variance for the F1:2 bulks and hence a lower heritability, the adverse effects of which will be discussed below.

Genomic prediction of GCA effects

Based on the developed theory, F1:2 bulks are expected to have a lower genetic variance than F1 hybrids. With constant residual variation, i.e., F1 and F1:2 training sets phenotyped with same number of locations and replications, the latter is thus expected to have a lower heritability. Prediction accuracy is expected to decrease with decreasing heritability of the training set phenotypes (Daetwyler et al. 2010; Lorenz 2013). The reduced prediction accuracy coming from the F1:2 training set in the “constant residual variation” scenario (Table 2) thus was in part due to the lower heritability of the F1:2 phenotypes. Indeed, when both training sets had the same heritability, accuracy was similar, too. In the convergent heterotic group scenario the accuracy of the F1:2 training set was then even slightly higher than that of the F1 training set. SCA effects essentially act as noise and even modeling them is unlikely to completely remove their confounding effects on the estimation of GCA effects. This surprising result can therefore be explained by the relatively lower amount of SCA variation in the F1:2 training set, as indicated by the theoretical results (Figures 3F, 4F, and 4L). SCA variation is expected to be relatively less important under a divergent heterotic group structure, as shown by theory and simulation results obtained here and elsewhere (Reif et al. 2007) as well as in practice (Fischer et al. 2009). The relatively lower amount of SCA variation in the F1:2 training set will therefore be less of a benefit in this case.

Even if the genomic model fitted could explain 100% of the genetic variation in the F1:2 bulks, the prediction accuracy would have an upper bound proportional to the correlation between F1 and F1:2 genetic effects. It was shown here that this correlation is expected to decrease with increasing allele divergence between heterotic groups and observed to be lower lower in the divergent heterotic groups structure than in the convergent structure. Finally, both theory and the simulation show that the relative reduction in genetic variance is greater, the greater the degree of divergence. With a constant residual variation, the reduction in heritability was therefore larger in the divergent scenario. These three factors combined, i.e., the lower benefit from the reduced proportion of SCA variance, the lower correlation between F1 and F1:2 genetic effects, and the lower heritability can explain why a larger accuracy penalty from using F1:2 training sets was observed for the divergent heterotic group structure.

The described trends held in general for prediction of tested and untested DHs. The differences between the accuracy from F1 and F1:2 training sets, however, were larger when predicting tested DH lines than for untested ones (Table 2), at least for the “constant residual variation” scenario. Genomic predictions of tested individuals (i.e., individuals contributing to the training set), are strongly influenced by the phenotypic observations available for them (Endelman and Jannink 2012; Müller et al. 2015). It can be speculated that they are therefore more sensitive to differences in F1 and F1:2 genetic values and the lower heritability of the latter. Nonetheless, accuracy for tested DH was always considerably higher than for untested DH. Each tested DH was not only represented in the training set directly in the form of a hybrid progeny, but also had 24 full-sib DH that directly contributed to the training set as well. Previous studies demonstrated the positive effect on prediction accuracy of direct observations (e.g., Endelman et al. 2014) and presence of full-sibs in the training set (Habier et al. 2013; Riedelsheimer et al. 2013; Schopp et al. 2017). The trends concerning accuracy of F1 and F1:2 training sets also held for within and across family prediction. That the latter was considerably more accurate was expected because it is largely driven by separation of family means (Windhausen et al. 2013; Riedelsheimer et al. 2013).

Genomic prediction of hybrid performance

Because GCA is an important component of total hybrid performance, similar trends were observed here. Namely that the prediction accuracy from the F1:2 training set was trailing that of the F1 training set under constant residual variation but caught up to or even exceeded it under constant heritability (Table 3). Similarly, the accuracy difference was larger for the divergent population structure and for hybrids that were part of the training set (T3). The explanations given above for GCA apply also here. That prediction for T3 hybrids was most accurate, followed by that of T2, T1 and T0 hybrids, was observed in previous studies (e.g., Technow et al. 2014a; Zhao et al. 2015) and is a result of the decreasing degree of relatedness between the hybrids in the four classes and the training set. SCA represents higher order statistical effects and is therefore estimated with greater error than the GCA effects contributing to hybrid performance (Technow et al. 2012; Kadam et al. 2016). Their accuracy was therefore considerably lower than that of GCA effects (compare the “across population” section of Table 2 with Table 3). Because it is relatively less important with divergent heterotic groups, the lower accuracy of predicted SCA effect will matter less for determining total hybrid performance, which consequently was predicted with greater accuracy than in the convergent scenario.

There has recently been interest in revisiting reciprocal full-sib mating designs (Hallauer and Eberhart 1970) in light of advances in genomic prediction of hybrid (Technow et al. 2012; Kadam et al. 2016; Fritsche-Neto et al. 2018) and GCA (Giraud et al. 2017) performance. As noted by Giraud et al. (2017), reciprocal testing has several advantages over the still predominant topcross design, in which individuals under evaluation are crossed with a common partner (“tester”) from the opposite heterotic group (Jenkins and Brunson 1932). A major advantage is that field testing is twice as efficient because testcross hybrids are informative for both heterotic groups, meaning that the same number of individuals can be tested with half the resources (e.g., 1,000 instead of 500 total hybrids would have been required to represent 500 male and 500 female DH if a topcross design would have been used). The other advantage is that when the crosses are made at random, they comply with the assumptions of a gene-orthogonal population (Schnell 1965) thus facilitating unbiased estimation of random GCA and SCA effects and their variances. The training set used in this study was constructed in this reciprocal fashion by directly pairing male and female DH at random, without the use of a topcross tester. The results are thus additional confirmation that hybrid performance as well as GCA and SCA effects can be evaluated and predicted accurately with such a design, even when each parent is represented in only a single hybrid combination.

Practical considerations

This study focused on assessing the theoretical potential of using F1:2 bulks for evaluating and predicting F1 hybrid and GCA performance, based on measures such as the expected correlations between F1 and F1:2 derived performance values and effects on genomic prediction accuracy. However, biological and practical considerations will also factor into the relative merit of the proposed approach. Key considerations hereby are the seed multiplication rate (= number of seeds harvested per plant) and the seeding rate (= number of seeds planted per area unit) of the crop in question. Both will determine how many F1 plants, which have to be generated by hand pollination, are required to produce the amount of F1:2 seed needed for conducting multi-environment field trials. All else equal, the proposed approach will be more promising for crops with high seed multiplication rate and low seeding rate, like rapeseed and sugar beet, than for crops with a low multiplication rate and high seeding rate, which tends to be the case for many small grain cereals. Other factors influencing the economical viability of F1:2 production for research purposes include flower morphology, determining the ease with which hand pollination can be carried out, and ultimately also the availability and cost of labor. Those biological and practical factors, however, are highly crop specific and, as far as labor costs are concerned, also depend on the geography of the breeding program. A detailed economic cost-benefit analysis of the F1:2 approach is therefore not within the scope of this study.

In cases where neither the implementation of a hybridization system nor the production of F1:2 seed is feasible on a large scale, inbred per-se evaluation might be considered. The correlation between inbred per-se and testcross performance is, however, typically expected to be low for complex traits like grain yield (Smith 1986; Schopp et al. 2015). This therefore seems promising only for scenarios in which selection for simply inherited traits with predominantly additive gene action is important and can be carried out as a first step in a multi-stage (genomic or phenotypic) selection scheme. Production of either F1 (through a hybridization system) or F1:2 seed for testcross evaluation might then be possible for the much reduced set of selected inbred lines.

A reduction in heritability was identified as the main factor reducing prediction accuracy of F1:2 training sets relative to that of F1 training sets, rather than differences in F1 and F1:2 genetic values. Options for increasing the heritability of F1:2 phenotypes include testing in more environments and/or replications and possibly in larger field plots (Rebetzke et al. 2014). Alternatively, the lower heritability could partly be compensated by increasing training set size (Lorenz 2013). The increase in resource requirements associated with each option might be justifiable with the expected reduction in complexity and cost of seed production.

This study showed that the ability of F1:2 training sets to predict GCA and hybrid performance on the F1 level is expected to be greater, the lower the degree of divergence between heterotic groups. Most crops for which hybrid breeding is considered promising currently lack clearly defined heterotic patterns (Melchinger and Gumber 1998; Zhao et al. 2015; Beukert et al. 2017), certainly not to the extent present in maize, where many decades of reciprocal-recurrent selection led to a system of divergent, co-evolving heterotic groups (Duvick et al. 2004; Technow et al. 2014a; Gerke et al. 2015). Thus, for many crop species, for which the lack of an efficient and reliable hybridization system is a major impediment (Longin et al. 2012), resorting to F1:2 bulks is particularly promising.

It should be noted that for all self-pollinating crop species, the baseline for comparison are not the “true” F1 hybrids considered in this study, but those produced with the help of hybridization systems. Chemical hybridization agents (CHA), for example, often result in only partial sterility of the female parent, meaning that a certain proportion of the harvested seed is in fact the result of a self pollination. The degree with which this happens is genotype dependent (Adugna et al. 2004), leading to a potential confounding of genetic effects and F1 seed purity in field trials. In a CMS system, several cycles of backcrossing are required to develop sterile “A-line” versions of the female inbred lines. In early backcrossing generations, the A-lines still contain significant amounts of donor genome and do not accurately reflect the B-line genotype (Ahmadikhah et al. 2015). Neither is necessarily a major concern for production of commercial seed, where CHA applications can be optimized for each commercial hybrid and there is enough time for as many cycles of backcrossing as necessary to remove nearly all residual donor genome. Optimization of CHA applications for hundreds or thousands of experimental hybrids used in a training set or for testcross evaluation, however, is unfeasible, and carrying out three or more cycles of backcrossing before testcrossing would increase the total length of the breeding cycle significantly. Thus, the F1 hybrids used in practice for training set development and testcross evaluation are also not expected to reflect “true” F1 performance without bias.

Even in the “worst-case” scenario however, i.e., without the ability of compensating for the reduced heritability of F1:2 bulks and with strong divergence between heterotic groups, should the prediction accuracy observed here for GCA and hybrid performance of tested and untested individuals be high enough to facilitate genetic gain and identification of superior hybrids. The modest accuracy penalty when using F1:2 bulks might therefore be a reasonable price to pay for the prospect of removing the significant complication and resource requirement of a hybridization system from the breeding process.

Acknowledgements

This article is dedicated to Albrecht E. Melchinger on the occasion of his retirement, to honour his lasting contribution to plant breeding and genetics and his teaching and guidance that shaped generations of students.

Footnotes

Supplemental material available at Figshare: https://doi.org/10.25387/g3.7493996.

Communicating editor: J.-L. Jannink

Literature Cited

  1. Adugna A., Nanda G., Singh K., Bains N., 2004.  A comparison of cytoplasmic and chemically-induced male sterility systems for hybrid seed production in wheat (Triticum aestivum L.). Euphytica 135: 297–304. 10.1023/B:EUPH.0000013320.28114.c6 [DOI] [Google Scholar]
  2. Ahmadikhah A., Mirarab M., Pahlevani M. H., Nayyeripasand L., 2015.  Marker-assisted backcrossing to develop an elite cytoplasmic male sterility line in rice. Plant Genome 8 10.3835/plantgenome2014.07.0031 [DOI] [PubMed] [Google Scholar]
  3. Albrecht T., Wimmer V., Auinger H.-J., Erbe M., Knaak C., et al. , 2011.  Genome based prediction of testcross values in maize. Theor. Appl. Genet. 123: 339–350. 10.1007/s00122-011-1587-7 [DOI] [PubMed] [Google Scholar]
  4. Araus J. L., Cairns J. E., 2014.  Field high-throughput phenotyping: the new crop breeding frontier. Trends Plant Sci. 19: 52–61. 10.1016/j.tplants.2013.09.008 [DOI] [PubMed] [Google Scholar]
  5. Bennewitz J., Meuwissen T. H. E., 2010.  The distribution of QTL additive and dominance effects in porcine F2 crosses. J. Anim. Breed. Genet. 127: 171–179. 10.1111/j.1439-0388.2009.00847.x [DOI] [PubMed] [Google Scholar]
  6. Bernardo R., 1996.  Best linear unbiased prediction of the performance of crosses between untested maize inbreds. Crop Sci. 36: 872–876. 10.2135/cropsci1996.0011183X003600040009x [DOI] [Google Scholar]
  7. Beukert U., Li Z., Liu G., Zhao Y., Ramachandra N., et al. , 2017.  Genome-based identification of heterotic patterns in rice. Rice (N. Y.) 10: 22 10.1186/s12284-017-0163-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Bohra A., Jha U. C., Adhimoolam P., Bisht D., Singh N. P., 2016.  Cytoplasmic male sterility (CMS) in hybrid breeding in field crops. Plant Cell Rep. 35: 967–993. 10.1007/s00299-016-1949-3 [DOI] [PubMed] [Google Scholar]
  9. Bosland P. W., 2005.  Second generation (F2) hybrid cultivars for Jalapeño production. HortScience 40: 1679–1681. 10.21273/HORTSCI.40.6.1679 [DOI] [Google Scholar]
  10. Comstock R. E., Robinson H. F., 1948.  The components of genetic variance in populations of biparental progenies and their use in estimating the average degree of dominance. Biometrics 4: 254–266. 10.2307/3001412 [DOI] [PubMed] [Google Scholar]
  11. Comstock R. E., Robinson H. F., 1952.  Estimation of average dominance of genes. In Heterosis, pp. 494–516, Iowa State College, Ames, IA. [Google Scholar]
  12. Cooper M., Messina C. D., Podlich D., Totir L. R., Baumgarten A., et al. , 2014.  Predicting the future of plant breeding: complementing empirical evaluation with genetic prediction. Crop Pasture Sci. 65: 311 10.1071/CP14007 [DOI] [Google Scholar]
  13. Daetwyler H. D., Pong-Wong R., Villanueva B., Woolliams J. A., 2010.  The impact of genetic architecture on genome-wide evaluation methods. Genetics 185: 1021–1031. 10.1534/genetics.110.116855 [DOI] [PMC free article] [PubMed] [Google Scholar]
  14. Duvick D., 1999.  Heterosis: feeding people and protecting natural resources, pp. 19–29 in The genetics and exploitation of heterosis in crops, edited by Coors J., Pandey S. CSSA, Madison, WI. [Google Scholar]
  15. Duvick D., Smith J., Cooper M., 2004.  Long-term selection in a commercial hybrid maize breeding program, pp. 109–152 in Plant Breeding Reviews, edited by Janick J. John Wiley & Sons, Inc., Hoboken, NJ. [Google Scholar]
  16. Dwivedi S. L., Britt A. B., Tripathi L., Sharma S., Upadhyaya H. D., et al. , 2015.  Haploids: constraints and opportunities in plant breeding. Biotechnol. Adv. 33: 812–829. 10.1016/j.biotechadv.2015.07.001 [DOI] [PubMed] [Google Scholar]
  17. Endelman J. B., Atlin G. N., Beyene Y., Semagn K., Zhang X., et al. , 2014.  Optimal design of preliminary yield trials with genome-wide markers. Crop Sci. 54: 48–59. 10.2135/cropsci2013.03.0154 [DOI] [Google Scholar]
  18. Endelman J. B., Jannink J.-L., 2012.  Shrinkage estimation of the realized relationship matrix. G3 (Bethesda) 2: 1405–1413. 10.1534/g3.112.004259 [DOI] [PMC free article] [PubMed] [Google Scholar]
  19. Falconer D. S., Mackay T. F. C., 1996.  Introduction to quantitative genetics, Ed. 4th Pearson, London. [Google Scholar]
  20. Fischer S., Möhring J., Maurer H. P., Piepho H.-P., Thiemt E.-M., et al. , 2009.  Impact of genetic divergence on the ratio of variance due to specific vs. general combining ability in winter triticale. Crop Sci. 49: 2119–2122. 10.2135/cropsci2008.12.0689 [DOI] [Google Scholar]
  21. Fritsche-Neto R., Akdemir D., Jannink J.-L., 2018.  Accuracy of genomic selection to predict maize single-crosses obtained through different mating designs. Theor. Appl. Genet. 131: 1153–1162. 10.1007/s00122-018-3068-8 [DOI] [PubMed] [Google Scholar]
  22. Fritsche-Neto R., Akdemir D., Jannink J. L., 2018.  Correction to: accuracy of genomic selection to predict maize single-crosses obtained through different mating designs. Theor. Appl. Genet. 131: 1603 (erratum) 10.1007/s00122-018-3118-2 [DOI] [PubMed] [Google Scholar]
  23. Fu Y., Wen T.-J., Ronin Y. I., Chen H. D., Guo L., et al. , 2006.  Genetic dissection of intermated recombinant inbred lines using a new genetic map of maize. Genetics 174: 1671–1683. 10.1534/genetics.106.060376 [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Gardner C., 1963.  Estimates of genetic parameters in cross-fertilizing plants and their implications in plant breeding, pp. 225–251 in Statistical Genetics and Plant Breeding, Vol. 982 Comittee on Plant Breeding and Genetics of the Agricultural Board at the North Carolina State College, Raleigh, NC [Google Scholar]
  25. Gaynor R. C., Gorjanc G., Bentley A. R., Ober E. S., Howell P., et al. , 2017.  A two-part strategy for using genomic selection to develop inbred lines. Crop Sci. 57: 2372–2386. 10.2135/cropsci2016.09.0742 [DOI] [Google Scholar]
  26. Gerke J. P., Edwards J. W., Guill K. E., Ross-Ibarra J., McMullen M. D., 2015.  The genomic impacts of drift and selection for hybrid performance in maize. Genetics 201: 1201–1211. 10.1534/genetics.115.182410 [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Giraud H., Bauland C., Falque M., Madur D., Combes V., et al. , 2017.  Reciprocal genetics: identifying QTLs for general and specific combining abilities in hybrids between multiparental populations from two maize (Zea mays L.) heterotic groups. Genetics 207: 1167–1180. 10.1534/genetics.117.300305 [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Gorjanc G., Battagin M., Dumasy J.-F., Antolin R., Gaynor R. C., et al. , 2017.  Prospects for cost-effective genomic selection via accurate within-family imputation. Crop Sci. 57: 216–228. 10.2135/cropsci2016.06.0526 [DOI] [Google Scholar]
  29. Habier D., Fernando R. L., Garrick D. J., 2013.  Genomic BLUP decoded: a look into the black box of genomic prediction. Genetics 194: 597–607. 10.1534/genetics.113.152207 [DOI] [PMC free article] [PubMed] [Google Scholar]
  30. Hallauer A. R., Eberhart S. A., 1970.  Reciprocal full-sib selection. Crop Sci. 10: 315–316. 10.2135/cropsci1970.0011183X001000030033x [DOI] [Google Scholar]
  31. Hedden P., 2003.  The genes of the green revolution. Trends Genet. 19: 5–9. 10.1016/S0168-9525(02)00009-4 [DOI] [PubMed] [Google Scholar]
  32. Heffner E. L., Lorenz A. J., Jannink J.-L., Sorrells M. E., 2010.  Plant breeding with genomic selection: gain per unit time and cost. Crop Sci. 50: 1681–1690. 10.2135/cropsci2009.11.0662 [DOI] [Google Scholar]
  33. Henderson C. R., 1973.  Sire evaluation and genetic trends. J. Anim. Sci. 1973: 10–41. 10.1093/ansci/1973.Symposium.10 [DOI] [Google Scholar]
  34. Hickey J. M., Dreisigacker S., Crossa J., Hearne S., Babu R., et al. , 2014.  Evaluation of genomic selection training population designs and genotyping strategies in plant breeding programs using simulation. Crop Sci. 54: 1476–1488. 10.2135/cropsci2013.03.0195 [DOI] [Google Scholar]
  35. Hickey J. M., Gorjanc G., Varshney R. K., Nettelblad C., 2015.  Imputation of single nucleotide polymorphism genotypes in biparental, backcross, and topcross populations with a hidden Markov model. Crop Sci. 55: 1934–1946. 10.2135/cropsci2014.09.0648 [DOI] [Google Scholar]
  36. Hill W. G., Goddard M. E., Visscher P. M., 2008.  Data and theory point to mainly additive genetic variance for complex traits. PLoS Genet. 4: e1000008 10.1371/journal.pgen.1000008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  37. Holland J. B., 2001.  Epistasis and plant breeding, pp. 27–92 in Plant Breeding Reviews, edited by Janick J. John Wiley & Sons, Inc., Hoboken, NJ. [Google Scholar]
  38. Huang X., Yang S., Gong J., Zhao Y., Feng Q., et al. , 2015.  Genomic analysis of hybrid rice varieties reveals numerous superior alleles that contribute to heterosis. Nat. Commun. 6: 6258 10.1038/ncomms7258 [DOI] [PMC free article] [PubMed] [Google Scholar]
  39. Jan H. U., Abbadi A., Lücke S., Nichols R. A., Snowdon R. J., 2016.  Genomic prediction of testcross performance in canola (Brassica napus). PLoS One 11: e0147769 10.1371/journal.pone.0147769 [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Janick J., 1998.  Hybrids in horticultural crops. CSSA Special Publication 25: 45–56. [Google Scholar]
  41. Jannink J.-L., Lorenz A. J., Iwata H., 2010.  Genomic selection in plant breeding: from theory to practice. Brief. Funct. Genomics Proteomics 9: 166–177. 10.1093/bfgp/elq001 [DOI] [PubMed] [Google Scholar]
  42. Jenkins M. T., Brunson A. M., 1932.  Methods of testing inbred lines of maize in crossbred combinations. Agron. J. 24: 523–530. 10.2134/agronj1932.00021962002400070004x [DOI] [Google Scholar]
  43. Kadam D. C., Potts S. M., Bohn M. O., Lipka A. E., Lorenz A. J., 2016. Genomic prediction of single crosses in the early stages of a maize hybrid breeding pipeline. G3 (Bethesda) 6: 3442–3453. https://10.1534/g3.116.031286 [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Kempe K., Gils M., 2011.  Pollination control technologies for hybrid breeding. Mol. Breed. 27: 417–437. 10.1007/s11032-011-9555-0 [DOI] [Google Scholar]
  45. Kim Y.-J., Zhang D., 2018.  Molecular control of male fertility for crop hybrid breeding. Trends Plant Sci. 23: 53–65. 10.1016/j.tplants.2017.10.001 [DOI] [PubMed] [Google Scholar]
  46. Labate J., Lamkey K. R., Lee M., Woodman W. L., 1999.  Temporal changes in allele frequencies in two reciprocally selected maize populations. Theor. Appl. Genet. 99: 1166–1178. 10.1007/s001220051321 [DOI] [Google Scholar]
  47. Larièpe A., Mangin B., Jasson S., Combes V., Dumas F., et al. , 2012.  The genetic basis of heterosis: multiparental quantitative trait loci mapping reveals contrasted levels of apparent overdominance among traits of agronomical interest in maize (Zea mays L.). Genetics 190: 795–811. 10.1534/genetics.111.133447 [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Larièpe A., Moreau L., Laborde J., Bauland C., Mezmouk S., et al. , 2017.  General and specific combining abilities in a maize (Zea mays L.) test-cross hybrid panel: relative importance of population structure and genetic divergence between parents. Theor. Appl. Genet. 130: 403–417. 10.1007/s00122-016-2822-z [DOI] [PubMed] [Google Scholar]
  49. Longin C. F. H., Mi X., Würschum T., 2015.  Genomic selection in wheat: optimum allocation of test resources and comparison of breeding strategies for line and hybrid breeding. Theor. Appl. Genet. 128: 1297–1306. 10.1007/s00122-015-2505-1 [DOI] [PubMed] [Google Scholar]
  50. Longin C. F. H., Mühleisen J., Maurer H. P., Zhang H., Gowda M., et al. , 2012.  Hybrid breeding in autogamous cereals. Theor. Appl. Genet. 125: 1087–1096. 10.1007/s00122-012-1967-7 [DOI] [PubMed] [Google Scholar]
  51. Lorenz A. J., 2013.  Resource allocation for maximizing prediction accuracy and genetic gain of genomic selection in plant breeding: a simulation experiment. G3 (Bethesda) 3: 481–491. 10.1534/g3.112.004911 [DOI] [PMC free article] [PubMed] [Google Scholar]
  52. Massman J. M., Gordillo A., Lorenzana R. E., Bernardo R., 2013.  Genomewide predictions from maize single-cross data. Theor. Appl. Genet. 126: 13–22. 10.1007/s00122-012-1955-y [DOI] [PubMed] [Google Scholar]
  53. Melchinger A. E., 1999.  Genetic diversity and heterosis, pp. 99–118 in The genetics and exploitation of heterosis in crops, edited by Coors J., Pandey S. ASA, CSSA, and SSSA, Madison, WI. [Google Scholar]
  54. Melchinger A. E., Gumber R. K., 1998.  Overview of heterosis and heterotic groups in agronomic crops, pp. 29–44 in Concepts and Breeding of Heterosis in Crop Plant, CSSA, Madison, WI. [Google Scholar]
  55. Melchinger, A. E., C. F. H. Longin, H. F. Utz, and J. C. Reif, 2005 Hybrid maize breeding with doubled haploid lines: quantitative genetic and selection theory for optimum allocation of resources. In Proceedings of the forty first annual Illinois corn breeders’ School 2005, pp. 8–21, Urbana-Champaign, Illinois, USA. [Google Scholar]
  56. Meuwissen T. H. E., Hayes B. J., Goddard M. E., 2001.  Prediction of total genetic value using genome-wide dense marker maps. Genetics 157: 1819–1829. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Mikel M. A., Dudley J. W., 2006.  Evolution of North American dent corn from public to proprietary germplasm. Crop Sci. 46: 1193–1205. 10.2135/cropsci2005.10-0371 [DOI] [Google Scholar]
  58. Mood A. M., Graybill F. A., Duane C. B., 1973.  Introduction to the theory of statistics, Ed. 3rd McGraw Hill, New York. [Google Scholar]
  59. Müller D., Technow F., Melchinger A. E., 2015.  Shrinkage estimation of the genomic relationship matrix can improve genomic estimated breeding values in the training set. Theor. Appl. Genet. 128: 693–703. 10.1007/s00122-015-2464-6 [DOI] [PubMed] [Google Scholar]
  60. Pérez P., Campos G., 2014.  Genome-wide regression & prediction with the BGLR statistical package. Genetics 198: 483–495. 10.1534/genetics.114.164442 [DOI] [PMC free article] [PubMed] [Google Scholar]
  61. Poland J. A., Rife T. W., 2012.  Genotyping-by-sequencing for plant breeding and genetics. Plant Genome 5: 92–102. 10.3835/plantgenome2012.05.0005 [DOI] [Google Scholar]
  62. R Core Team , 2018.  R: a language and environment for statistical computing, R Foundation for Statistical Computing, Vienna, Austria. [Google Scholar]
  63. Radoev M., Becker H. C., Ecke W., 2008.  Genetic analysis of heterosis for yield and yield components in rapeseed (Brassica napus L.) by quantitative trait locus mapping. Genetics 179: 1547–1558. 10.1534/genetics.108.089680 [DOI] [PMC free article] [PubMed] [Google Scholar]
  64. Rebetzke G. J., Fischer R. T. A., Herwaarden A. F., Bonnett D. G., Chenu K., et al. , 2014.  Plot size matters: interference from intergenotypic competition in plant phenotyping studies. Funct. Plant Biol. 41: 107–118. 10.1071/FP13177 [DOI] [PubMed] [Google Scholar]
  65. Reif J. C., Gumpert F.-M., Fischer S., Melchinger A. E., 2007.  Impact of interpopulation divergence on additive and dominance variance in hybrid populations. Genetics 176: 1931–1934. 10.1534/genetics.107.074146 [DOI] [PMC free article] [PubMed] [Google Scholar]
  66. Riedelsheimer C., Endelman J. B., Stange M., Sorrells M. E., Jannink J.-L., et al. , 2013.  Genomic predictability of interconnected biparental maize populations. Genetics 194: 493–503. 10.1534/genetics.113.150227 [DOI] [PMC free article] [PubMed] [Google Scholar]
  67. Rincent R., Laloe D., Nicolas S., Altmann T., Brunel D., et al. , 2012.  Maximizing the reliability of genomic selection by optimizing the calibration set of reference individuals: comparison of methods in two diverse groups of maize inbreds (Zea mays L.). Genetics 192: 715–728. 10.1534/genetics.112.141473 [DOI] [PMC free article] [PubMed] [Google Scholar]
  68. Schnell F., 1965.  Die Covarianz zwischen Verwandten in einer gen-orthogonalen Population. Biometrische Zeitung 7: 1–49. 10.1002/bimj.19650070102 [DOI] [PubMed] [Google Scholar]
  69. Schön C. C., Dhillon B. S., Utz H. F., Melchinger A. E., 2010.  High congruency of QTL positions for heterosis of grain yield in three crosses of maize. Theor. Appl. Genet. 120: 321–332. 10.1007/s00122-009-1209-9 [DOI] [PubMed] [Google Scholar]
  70. Schopp P., Müller D., Technow F., Melchinger A. E., 2017.  Accuracy of genomic prediction in synthetic populations depending on the number of parents, relatedness, and ancestral linkage disequilibrium. Genetics 205: 441–454. 10.1534/genetics.116.193243 [DOI] [PMC free article] [PubMed] [Google Scholar]
  71. Schopp P., Riedelsheimer C., Utz H. F., Schön C.-C., Melchinger A. E., 2015.  Forecasting the accuracy of genomic prediction with different selection targets in the training and prediction set as well as truncation selection. Theor. Appl. Genet. 128: 2189–2201. 10.1007/s00122-015-2577-y [DOI] [PubMed] [Google Scholar]
  72. Semel Y., Nissenbaum J., Menda N., Zinder M., Krieger U., et al. , 2006.  Overdominant quantitative trait loci for yield and fitness in tomato. Proc. Natl. Acad. Sci. USA 103: 12981–12986. 10.1073/pnas.0604635103 [DOI] [PMC free article] [PubMed] [Google Scholar]
  73. Shull, G. H., 1908 The composition of a field of maize. J Hered os-4: 296–301.
  74. da Silva Dias J. C., 2010.  Impact of improved vegetable cultivars in overcoming food insecurity. Euphytica 176: 125–136. 10.1007/s10681-010-0237-5 [DOI] [Google Scholar]
  75. Smith O. S., 1986.  Covariance between line per se and testcross performance. Crop Sci. 26: 540–543. 10.2135/cropsci1986.0011183X002600030023x [DOI] [Google Scholar]
  76. Sprague G. F., Tatum L. A., 1942.  General vs. specific combining ability in single crosses of corn. Agron. J. 34: 923–932. 10.2134/agronj1942.00021962003400100008x [DOI] [Google Scholar]
  77. Stuber C. W., 1970.  Estimation of genetic variances using inbred relatives. Crop Sci. 10: 129–135. 10.2135/cropsci1970.0011183X001000020002x [DOI] [Google Scholar]
  78. Stuber C. W., Cockerham C. C., 1966.  Gene effects and variances in hybrid populations. Genetics 54: 1279–1286. [DOI] [PMC free article] [PubMed] [Google Scholar]
  79. Tardieu F., Cabrera-Bosquet L., Pridmore T., Bennett M., 2017.  Plant phenomics, from sensors to knowledge. Curr. Biol. 27: R770–R783. 10.1016/j.cub.2017.05.055 [DOI] [PubMed] [Google Scholar]
  80. Technow, F., 2013 hypred: Simulation of genomic data in applied genetics. R package version 0.4.
  81. Technow F., Gerke J. P., 2017.  Parent-progeny imputation from pooled samples for cost-efficient genotyping in plant breeding. PLoS One 12: e0190271 10.1371/journal.pone.0190271 [DOI] [PMC free article] [PubMed] [Google Scholar]
  82. Technow F., Riedelsheimer C., Schrag T. A., Melchinger A. E., 2012.  Genomic prediction of hybrid performance in maize with models incorporating dominance and population specific marker effects. Theor. Appl. Genet. 125: 1181–1194. 10.1007/s00122-012-1905-8 [DOI] [PubMed] [Google Scholar]
  83. Technow F., Schrag T. A., Schipprack W., Bauer E., Simianer H., et al. , 2014a Genome properties and prospects of genomic prediction of hybrid performance in a breeding program of maize. Genetics 197: 1343–1355. 10.1534/genetics.114.165860 [DOI] [PMC free article] [PubMed] [Google Scholar]
  84. Technow F., Schrag T. A., Schipprack W., Melchinger A. E., 2014b Identification of key ancestors of modern germplasm in a breeding program of maize. Theor. Appl. Genet. 127: 2545–2553. 10.1007/s00122-014-2396-6 [DOI] [PubMed] [Google Scholar]
  85. VanRaden P. M., 2008.  Efficient methods to compute genomic predictions. J. Dairy Sci. 91: 4414–4423. 10.3168/jds.2007-0980 [DOI] [PubMed] [Google Scholar]
  86. Whitford R., Fleury D., Reif J. C., Garcia M., Okada T., et al. , 2013.  Hybrid breeding in wheat: technologies to improve hybrid wheat seed production. J. Exp. Bot. 64: 5411–5428. 10.1093/jxb/ert333 [DOI] [PubMed] [Google Scholar]
  87. Windhausen V. S., Atlin G. N., Hickey J. M., Crossa J., Jannink J.-L., et al. , 2013.  Effectiveness of genomic prediction of maize hybrid performance in different breeding populations and environments. G3 (Bethesda) 2: 1427–1436. 10.1534/g3.112.003699 [DOI] [PMC free article] [PubMed] [Google Scholar]
  88. Wu Y. T., Yin J. M., Guo W. Z., Zhu X. F., Zhang T. Z., 2004.  Heterosis performance of yield and fibre quality in F1 and F2 hybrids in upland cotton. Plant Breed. 123: 285–289. 10.1111/j.1439-0523.2004.00990.x [DOI] [Google Scholar]
  89. Würschum T., Reif J. C., Kraft T., Janssen G., Zhao Y., 2013.  Genomic selection in sugar beet breeding populations. BMC Genet. 14: 85 10.1186/1471-2156-14-85 [DOI] [PMC free article] [PubMed] [Google Scholar]
  90. Xu S., 2013.  Mapping quantitative trait loci by controlling polygenic background effects. Genetics 195: 1209–1222. 10.1534/genetics.113.157032 [DOI] [PMC free article] [PubMed] [Google Scholar]
  91. Zhao Y., Li Z., Liu G., Jiang Y., Maurer H. P., et al. , 2015.  Genome-based establishment of a high-yielding heterotic pattern for hybrid wheat breeding. Proc. Natl. Acad. Sci. USA 112: 15624–15629. 10.1073/pnas.1514547112 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The SNP genotypes of the Dent and Flint inbred lines used as the initial population and the physical map of the SNP are available from the online supplement of Technow et al. (2014a). Supplemental material available at Figshare: https://doi.org/10.25387/g3.7493996.


Articles from G3: Genes|Genomes|Genetics are provided here courtesy of Oxford University Press

RESOURCES