Skip to main content
Genetics, Selection, Evolution : GSE logoLink to Genetics, Selection, Evolution : GSE
. 2021 Mar 16;53:29. doi: 10.1186/s12711-021-00620-7

Integrating genomic and infrared spectral data improves the prediction of milk protein composition in dairy cattle

Toshimi Baba 1, Sara Pegolo 2,, Lucio F M Mota 2, Francisco Peñagaricano 3, Giovanni Bittante 2, Alessio Cecchinato 2, Gota Morota 1,4,
PMCID: PMC7968271  PMID: 33726672

Abstract

Background

Over the past decade, Fourier transform infrared (FTIR) spectroscopy has been used to predict novel milk protein phenotypes. Genomic data might help predict these phenotypes when integrated with milk FTIR spectra. The objective of this study was to investigate prediction accuracy for milk protein phenotypes when heterogeneous on-farm, genomic, and pedigree data were integrated with the spectra. To this end, we used the records of 966 Italian Brown Swiss cows with milk FTIR spectra, on-farm information, medium-density genetic markers, and pedigree data. True and total whey protein, and five casein, and two whey protein traits were analyzed. Multiple kernel learning constructed from spectral and genomic (pedigree) relationship matrices and multilayer BayesB assigning separate priors for FTIR and markers were benchmarked against a baseline partial least squares (PLS) regression. Seven combinations of covariates were considered, and their predictive abilities were evaluated by repeated random sub-sampling and herd cross-validations (CV).

Results

Addition of the on-farm effects such as herd, days in milk, and parity to spectral data improved predictions as compared to those obtained using the spectra alone. Integrating genomics and/or the top three markers with a large effect further enhanced the predictions. Pedigree data also improved prediction, but to a lesser extent than genomic data. Multiple kernel learning and multilayer BayesB increased predictive performance, whereas PLS did not. Overall, multilayer BayesB provided better predictions than multiple kernel learning, and lower prediction performance was observed in herd CV compared to repeated random sub-sampling CV.

Conclusions

Integration of genomic information with milk FTIR spectral can enhance milk protein trait predictions by 25% and 7% on average for repeated random sub-sampling and herd CV, respectively. Multiple kernel learning and multilayer BayesB outperformed PLS when used to integrate heterogeneous data for phenotypic predictions.

Background

Large-scale phenotyping is critical for efficient farm management and successful breeding programs [1]. Fourier transform infrared (FTIR) spectroscopy is a low-cost, non-destructive, and rapid technology that scans milk samples with an infrared light to detect specific chemical bonds [2]. FTIR spectroscopy has been routinely used to predict the chemical composition of milk in most herd recording programs [3, 4]. Recent studies have used milk FTIR spectral information to develop equations for predicting complex traits that are difficult and expensive to measure because of high phenotyping costs. These include milk fatty acids [5], energy intake [6], methane emissions [7], and metabolic profiles [8]. Milk FTIR spectral bands have also been used to predict cow health and pregnancy [912]. Milk protein composition, especially the casein component, is associated with cheese making, an important trait for the dairy industry [1315], and thus recent studies have attempted to leverage milk FTIR spectra for large-scale phenotyping for genetic selection [16]. Milk FTIR spectra can also be used for genetic improvement when there are strong additive genetic correlations between target traits and FTIR predictions [17, 18].

Recent technological advancements in phenotyping such as precision agriculture or high-throughput phenotyping create an opportunity to integrate multiple sources of information into a single statistical framework [1]. These sources may capture various signals affecting phenotypes and thus could be combined to improve prediction performance. Enhanced prediction performance of dairy cow fertility was reported for a model integrating milk spectra and on-farm data including herd, days in milk (DIM), and parity [10, 11]. The inclusion of genotype information slightly increased prediction accuracy further [11]. Wang and Bovenhuis [19] stated that combining milk FTIR spectra and polymorphisms located in known genes enhances the prediction accuracy of milk fat composition. Therefore, integrating milk FTIR spectra with genomic data may constitute an alternative strategy for improving prediction accuracy.

Partial least squares (PLS) regression is frequently used in spectral analysis [20]. However, it does not permit different weights or priors to be directly assigned to each source of information in a straightforward manner, particularly when spectral and genomic data are integrated. Here, we hypothesized that a model handling heterogeneous data sources, including on-farm variables, milk FTIR spectra, genomic data, and pedigree information, can enhance prediction, especially when genomic or pedigree data capture phenotypic variation that milk spectra do not explain. The objective of this study was to assess the prediction of milk protein composition by integrating milk FTIR spectra, on-farm data, and genomic or pedigree information with cross-validation (CV). The second objective was to compare the predictive performance of two alternative statistical models. We evaluated multiple kernel learning coupled with spectral and genomic (pedigree) relationship matrices constructed from the spectral and genomic (pedigree) profiles of individuals, respectively. We also assessed multilayer Bayesian variable selection by setting separate mixture priors on the spectral and genetic terms. Then, we compared the prediction performance of these two methods with that of PLS.

Methods

Data

In total, 966 Italian Brown Swiss cows with phenotypes, spectra, and genotypes were used in this study. Milk samples were collected from 85 commercial herds in Trento, Italy. More details about data collection are given in [5]. The average cow DIM and parity were 169.8 ± 101.8 and 2.4 ± 1.2, respectively. The average number of cows per herd was 11.4 ± 2.4. Two milk samples of each cow were collected and immediately refrigerated at 4 °C. One sample was transported to the milk quality laboratory at the Trento Breeders Federation (Trento, Italy) for milk composition analysis. The other sample was used for the milk protein analysis by a validated reversed-phase high-performance liquid chromatography (RP-HPLC) method [21].

The following traits were measured: true protein nitrogen (TP), total casein (TCN), total whey protein (TWP), κ-CN, β-CN, αS1-CN, αS2-CN casein fractions, and β-lactoglobulin (β-LG) and α-lactalbumin (α-LA) whey proteins. Here, TP comprises TCN and TWP, and is obtained by subtracting non-protein nitrogen (N) from total nitrogen. The fraction traits were calculated as % of total milk nitrogen content. The traits were then summed and subtracted from the total N content of the milk [22]. Milk FTIR spectral data included 1060 wavenumbers in the range of 5011 to 925 (cm-1) for each cow determined with a MilkoScan FT6000 (Foss, Hillerød, Denmark). Two spectral acquisitions were obtained for each milk sample and averaged before analysis. Pre-treatment of milk spectra was performed by checking the Mahalanobis distance after conducting principal component analysis. This analysis suggested four animals as potential outliers. However, the removal of these individuals did not influence predictive performance, and hence, we used the data without the pre-treatment.

All the cows in this study were genotyped with an Illumina BovineSNP50 v.2 BeadChip (Illumina, San Diego, CA, USA). Missing genotypes were imputed using a binomial distribution based on the frequency of the reference allele. After removing single nucleotide polymorphisms (SNPs) call rates <0.95 and minor allele frequencies <0.05, 37,519 SNPs were retained for subsequent analyses. Table 1 presents the descriptive statistics of milk protein composition.

Table 1.

Descriptive statistics of 966 cows for milk protein related phenotypes

Traitsa Mean SD
True protein nitrogen 89.1 2.25
Total casein 78.0 1.23
Total whey protein 11.1 1.70
κ-casein 9.45 1.48
β-casein 32.3 2.45
αS1-casein 25.7 1.79
αS2-casein 9.20 1.14
β-lactoglobulin 8.68 1.56
α-lactalbumin 2.39 0.50

a% total milk N

Statistical modeling

Three statistical approaches were used to combine multiple sources of information to predict nine phenotypes related to milk protein composition.

Multiple kernel learning

Kernel methods regress the phenotype on a kernel relationship matrix that is constructed using biological profiles of animals [23]. The model considered for the milk spectral data was:

y=Xb+ZIRuIR+e, 1

where y is the vector of phenotypic records, X is the design matrix for the on-farm data, b is the vector of the on-farm fixed effects, ZIR is the incidence matrix relating animals to phenotypic records, uIR is the vector of the random milk spectra values of the animals, and e is the vector of the residuals. The distributions of the random effects for the milk spectra and the residuals were assumed to follow uIRN(0,SσuIR2) and eN(0,Iσe2), respectively, where σuIR2 is the spectral variance, σe2 is the residual variance, S is the spectra-based relationship matrix, and I is an identity matrix. The spectral-based relationship matrix, which represents the similarity of milk FTIR among individuals, was computed as a function of the spectral wavenumber cross-product:

S=WIRWIRmIR, 2

where WIR is the centered and standardized wavenumber matrix and mIR=1060 is the total number of wavenumbers. The construction of the S matrix followed that of the genomic relationship matrix of VanRaden [24]. The only difference was the source of information to create the relationship matrix.

Genetic markers were integrated by extending the above Eq. (1) via multiple kernel learning as follows.

y=Xb+ZIRuIR+Zgug+e, 3

where Zg is the incidence matrix for the additive genetic effects and ug is the vector of the random additive genetic effects. The distribution of the random additive genetic effects was assumed to follow ugN(0,Gσug2), where σug2 is the variance of the additive genetic effects and G is the first genomic relationship matrix proposed by VanRaden [24]. Pedigree information was considered as an alternative source of genetic information. The genomic relationship matrix was then replaced with the numerator relationship matrix in Eq. (3) so that upN(0,Aσup2). Here, A is the pedigree-based kinship relationship matrix and σup2 is the pedigree-based variance of the additive genetic effects.

Multilayer Bayesian variable selection

BayesB [25] was used to fit the model including only spectral information.

y=Xb+i=1mIRWIRiaIRi+e,

where aIRi is the ith wavenumber effect. A Gaussian prior with large variance was assigned to b. The prior distribution of the ith wavenumber effect

p(aIRi|π,df,S)=π×t(aIRi|df,S)+(1-π)×(aIRi=0),

where π is the proportion of nonzero wavenumber effects and t(aIRi|df,S) is a scaled-t density with two hyperparameters, degrees of freedom, df, and scale, S. The residual variance was assigned a scaled-inverse χ2 density with degrees of freedom, dfe, and scale, Se [5].

This BayesB model was further extended to multilayer BayesB by adding a separate mixture prior for the SNP term.

y=Xb+mIRi=1WIRiaIRi+mSNPj=1WSNPjaSNPj+e,

where WSNPj is a vector of the centered and scaled genotypes at the jth SNP and aSNPj is the corresponding SNP effect. The prior distribution of the SNP effects followed that of the wavenumbers:

p(aSNPj|π,df,S)=π×t(aSNPj|df,S)+(1-π)×(aSNPj=0).

Multiple kernel learning and multilayer BayesB were implemented using the BGLR R package [26]. In multilayer BayesB, wavenumber hyperparameters were specified using the default rule in the package following Ferragina et al. [5]. For the SNP effects,“probin = 0.5” and “count = 10” were set to assign a Beta-prior for two fixed shape parameters and derived the proportion of nonzero SNP effects π for the SNP term [26]. The two shape parameters of the beta distribution π0 and p0 were set to 0.5(1-0.5)(10+1)=0.023 and 0.5, respectively. A total of 50,000 Markov Chain Monte Carlo samples after 50,000 burn-in with the thinning rate of 10 were used to obtain the posterior means for all unknowns.

Partial least squares

Partial least squares is one of the most common methods for spectral analysis and was used in this study as a baseline model. Unlike unsupervised principal component regression, PLS finds the latent variables that maximize the covariance between the predictors and the phenotypes while minimizing the error. This method was recently used to integrate spectral and genomic information [11, 19]. The mixOmics R package [27] was used to implement PLS. The optimum number of latent variables was determined using the root mean squared error with a maximum value of 50.

Evaluation of model performance

Table 2 displays the list of prediction models examined in this study. Model 1 (M1) was considered the baseline and included only spectral data. Both on-farm and genetic data were sequentially added to evaluate the gain from M1. Model 2 (M2) included herd and spectral effects because recent studies showed that herd information may greatly impact prediction performance. Model 3 (M3) included herd, DIM, parity, and spectral effects. Model 4 (M4) included herd, DIM, parity, milk spectra, and SNP data. M1 to M4 were fit across multiple kernel learning, multilayer BayesB, and PLS. Model 5 (M5) and Model 6 (M6) were applied to multiple kernel learning to make it more akin to multilayer BayesB by performing variable selection via association analysis. M5 included herd, DIM, parity, milk spectra, and the top three markers identified by genome-wide association analysis. The inclusion of markers with a large effect as fixed effects might improve prediction accuracy [28] because kernel methods weigh SNPs equally in the construction of a genomic relationship matrix. M4 was used to select the top three SNPs from the training data in cross-validation, as described later. M6 is the same as M5 except for the presence of a genomic relationship matrix constructed using all the markers excluding the top three SNPs. The top three SNPs were not considered in multilayer BayesB because this method performs variable selection internally. Pedigree information was used in Model 7 (M7) along with herd, DIM, parity, and spectral data assuming a practical situation where cow genotype data is not available for all individuals on a dairy farm. M7 was fit using multiple kernel learning and PLS.

Table 2.

A list of covariates included in multiple kernel learning, multilayer BayesB, and partial least squares (PLS)

Model Sub-model Effecta
Herd DIM Parity FTIR Genomics Top markers Pedigree
Kernel M1
M2
M3
M4
M5
M6
M7
BayesB M1
M2
M3
M4
PLS M1
M2
M3
M4
M7

aDIM: days in milk; FTIR: milk Fourier transform infrared spectroscopy; Top markers: top three markers with the largest effects; Genomics: genomic relationship matrix in kernel methods, markers in BayesB, and principal components of genomic relationship matrix in PLS; Pedigree: numerator relationship matrix in kernel methods and principal components of numerator relationship matrix in PLS

Cross-validation

Two CV scenarios repeated ten times were employed to assess model predictive performance for nine milk protein component traits. The phenotypes in the testing set were predicted by fitting multiple kernel learning, multilayer BayesB, and PLS in order to investigate the relative contributions of different sources of information according to Table 2. Predictive performance was evaluated using the prediction coefficient of determination (R2), which was calculated as the square of the correlation between the observed and predicted values in the testing set. The regression coefficient was also calculated by regressing the observed phenotypes of the individuals in the testing set on predicted values.

Repeated random sub-sampling cross-validation

We partitioned the data into training and testing sets of 716 and 250 cows, respectively. This CV was used because of a relatively small sample size. The predictive values of the testing set individuals y^tst were predicted using estimated spectra, on-farm data, or/and genetic effects in the following manner. The conditional expectation of E(y^tst|y^trn) was computed in kernel methods as Stst,trnS-1trn,trnu^IRtrn in M1, Xtstb^trn+Stst,trnS-1trn,trnu^IRtrn in M2 and M3, Xtstb^trn+Stst,trnS-1trn,trnu^IRtrn+Gtst,trnG-1trn,trnu^gtrn in M4, Xtstb^trn+Stst,trnS-1trn,trnu^IRtrn+WSNP3b^SNP3 in M5, Xtstb^trn+Stst,trnS-1trn,trnu^IRtrn+Gtst,trnG-1trn,trnu^gtrn+WSNP3b^SNP3 in M6, and Xtstb^trn+Stst,trnS-1trn,trnu^IRtrn+Atst,trnA-1trn,trnu^ptrn in M7. Here, Xtst and b^trn are the design matrix for on-farm data in the testing individuals and the corresponding effects estimated from the training set, respectively. And, Stst,trn, Gtst,trn and Atst,trn are relationship matrices between the testing and training individuals according to their spectra, genomic, and pedigree profiles, respectively. Similarly, S-1trn,trn, G-1trn,trn and A-1trn,trn are the inverse of relationship matrices between the individuals in the training set according to their spectra, genomic, and pedigree profiles, respectively. The vectors of u^IRtrn, u^gtrn, and u^ptrn are predicted spectral, additive genomic, and additive genetic values, respectively. The marker matrix WSNP3 includes the top three markers based on the absolute values of their marker effects and b^SNP3 is the vector of corresponding marker effects. In BayesB, y^tst was obtained as WIRtsta^IRtrn in M1, Xtstb^trn+WIRtsta^IRtrn in M2 and M3, Xtstb^trn+WIRtsta^IRtrn+WSNPtsta^SNPtrn in M4. Here, WIRtst and Wsnptst are the incidence matrices of the testing set individuals for wavenumbers and markers, respectively, and a^IRtrn and a^snptrn are the vectors of wavenumber and marker effects, respectively, obtained from the training set. In PLS, the principal components of G and A were extracted when fitting M4 and M7. The first 115 and 152 principal components of G and A were used, which explained over 80% of the variation. In PLS, the prediction was performed as Qtstq^trn, where Qtst is the principal component matrix extracted from the spectra, on-farm, or/and genetic covariates of the individuals in the testing set and q^trn is the vector of corresponding principal component effects estimated from the training set. The optimal number of principal components was determined in the training set and the same number of principal components was extracted in the testing set.

Herd cross-validation

The repeated random sub-sampling CV may result in over-prediction due to the dependency between herd and spectra variability [5, 7]. For this reason, herd CV, which is a random-sampling method based on herds, was explored to exclude the possibility of over-prediction. We randomly assigned 65 and 20 herds as training and testing sets, respectively. The number of individuals in the testing set in each run ranged from 223 to 251. In herd CV, the herd effect was not included in the aforementioned seven models. Thus, M2 with herd and spectral effects was not considered.

Results

Repeated random sub-sampling cross-validation

Figure 1 shows R2 values obtained by multiple kernel learning using repeated random sub-sampling CV. The model including spectra only (M1) produced the lowest R2 ranging from 0.14 to 0.82. When on-farm predictors were added to the models (herd in M2; herd, DIM, and parity in M3), R2 increased, except for β-CN, ranging from 0.20 to 0.92. The small difference observed in R2 between M2 and M3 indicates that DIM and parity made only small contributions compared to the herd effect. Joint modeling of spectra, on-farm information, and genomic data (M4) further improved R2 compared with M1 to M3 ranging from 0.31 to 0.91. In particular, prediction of β-CN was markedly improved. R2 was increased by fitting the top three markers as fixed effects (M5 and M6) for κ-CN and β-CN. However, prediction performance for the other traits did not clearly improve. Furthermore, R2 values from pedigree (M7) were higher than those for M1 to M3 but lower than or similar to that for M4. Therefore, considering genomic or pedigree information may improve the ability of a model to predict most milk protein traits. The regression coefficients obtained by using multiple kernel learning are listed in Table 3. M1 slightly underestimated predictions, with slope values ranging from 0.99 to 1.12. In contrast, M2 to M7 showed a tendency for over-prediction, with slope values ranging from 0.74 to 1.01. When genomic or pedigree data were added (M4 to M7), the extent of bias was smaller compared to those of M2 and M3.

Fig. 1.

Fig. 1

Prediction R-squared for milk protein traits (TP: true protein nitrogen; TCN: total casein; TWP: total whey protein; κ-CN: κ-casein; β-CN: β-casein; αS1-CN: αS1-casein; αS2-CN: αS2-casein; β-LG: β-lactoglobulin; α-LA: α-lactalbumin) from multiple kernel learning using repeated random sub-sampling cross-validation. S: spectral relationship matrix; G: genomic relationship matrix; A: numerator relationship matrix; DIM: days in milk; Top3SNP: top three markers with the largest effects.

Table 3.

Regression coefficients of predictive values for testing cows on observed phenotypes when fitting multiple kernel learning, multilayer BayesB, and partial least squares (PLS) using repeated random sub-sampling cross-validation

Traits Kernel BayesB PLS
M1 M2 M3 M4 M5 M6 M7 M1 M2 M3 M4 M1 M2 M3 M4 M7
True protein nitrogen 1.04 0.92 0.91 0.94 0.90 0.93 0.94 0.96 0.92 0.91 0.93 0.87 0.89 0.87 0.92 0.88
Total casein 1.02 1.01 1.01 1.01 1.01 1.00 1.01 0.98 0.97 0.96 0.99 0.98 0.98 0.97 0.97 0.98
Total whey protein 1.01 0.83 0.81 0.87 0.81 0.86 0.86 0.96 0.85 0.82 0.90 0.82 0.77 0.74 0.72 0.75
κ-casein 1.02 0.76 0.74 0.84 0.85 0.85 0.79 0.92 0.84 0.82 0.92 0.76 0.71 0.71 0.75 0.73
β-casein 1.12 0.78 0.78 0.92 0.93 0.94 0.86 0.97 0.84 0.82 0.96 0.83 0.83 0.86 0.85 0.84
αS1-casein 1.05 0.86 0.86 0.88 0.87 0.88 0.86 1.02 0.87 0.86 0.92 0.84 0.86 0.90 0.82 0.80
αS2-casein 1.02 0.84 0.83 0.83 0.80 0.79 0.83 0.99 0.84 0.83 0.85 0.79 0.78 0.78 0.66 0.64
β-lactoglobulin 0.99 0.84 0.83 0.88 0.83 0.88 0.87 0.99 0.85 0.85 0.90 0.76 0.75 0.78 0.77 0.73
α-lactalbumin 1.06 0.92 0.92 0.92 0.89 0.88 0.92 1.02 0.92 0.92 0.92 0.94 0.91 0.91 0.93 0.91

M1: milk Fourier transform infrared spectroscopy (FTIR)

M2: herd + FTIR

M3: herd + days in milk + parity + FTIR

M4: herd + days in milk + parity + FTIR + Genomics

M5: herd + days in milk + parity + FTIR + top three markers with the largest effects

M6: herd + days in milk + parity + FTIR + Genomics + top three markers with the largest effects

M7: herd + days in milk + parity + FTIR + pedigree

Figure 2 shows R2 values from multilayer BayesB. The model with spectra only (M1) yielded the lowest prediction for all traits. Note that R2 was improved when on-farm data were added to M1 (M2 to M3). Inclusion of the SNP data (M4) via multilayer BayesB produced the highest R2. Large improvements in R2 were observed for κ-CN , β-CN, and αS1-CN. For all traits, multilayer BayesB yielded higher R2 than multiple kernel learning. All regression coefficients were less than 1 except for αS1-CN and α-LA in M1 (Table 3). Moreover, bias was reduced by including genomic information.

Fig. 2.

Fig. 2

Prediction R-squared for milk protein traits (TP: true protein nitrogen; TCN: total casein; TWP: total whey protein; κ-CN: κ-casein; β-CN: β-casein; αS1-CN: αS1-casein; αS2-CN: αS2-casein; β-LG: β-lactoglobulin; α-LA: α-lactalbumin) from multilayer BayesB using repeated random sub-sampling cross-validation. FTIR: milk Fourier transform infrared spectroscopy; DIM: days in milk.

Figure 3 presents R2 values for the five alternative covariate sets (M1 to M4 and M7) fitted with PLS. In this case, R2 did not improve by adding on-farm, genomic, or pedigree information to spectra. In fact, genetic information even lowered R2 for certain traits. All regression coefficients were less than 1 (Table 3). The difference in prediction performance among multiple kernel learning, multilayer BayesB, and PLS was small for M1. However, multiple kernel learning and multilayer BayesB outperformed PLS when either on-farm data or genetic data were considered (M2 to M7). Note that, in most cases, multilayer BayesB performed better than multiple kernel learning.

Fig. 3.

Fig. 3

Prediction R-squared for milk protein traits (TP: true protein nitrogen; TCN: total casein; TWP: total whey protein; κ-CN: κ-casein; β-CN: β-casein; αS1-CN: αS1-casein; αS2-CN: αS2-casein; β-LG: β-lactoglobulin; α-LA: α-lactalbumin) from partial least squares using repeated random sub-sampling cross-validation. FTIR: milk Fourier transform infrared spectroscopy; G: Principal components of genomic relationship matrix; A: Principal components of numerator relationship matrix; DIM: days in milk.

Herd cross-validation

Herd CV was designed to avoid the over-prediction caused by the known relationship between herd and spectral variability. We considered the same covariate sets as those used in the repeated random sub-sampling CV except for the herd effect. Figures 4, 5, and 6 present R2 values produced by multiple kernel learning, multilayer BayesB, and PLS, respectively. As expected, herd CV showed lower R2 than the repeated random sub-sampling CV. In multiple kernel learning, the model including on-farm DIM and parity data (M3) did not provide better predictions than the model including spectra only (M1) (Fig. 4). Jointly fitting genomic and spectral relationship matrices (M4) did not increase R2. Nevertheless, R2 markedly increased for κ-CN and β-CN when the top three markers were included in the models (M5 and M6). In contrast, the addition of SNP data to the spectral data improved R2 for multilayer BayesB (M4) (Fig. 5). The genomic data did not increase R2 for PLS (Fig. 6). In multiple kernel learning, the pedigree data slightly improved R2 compared to that obtained using the spectra only. However, no increase in R2 was observed for PLS. The herd CV regression coefficients are presented in Table 4. There was upward bias in all models but the kernel methods and BayesB showed less bias than PLS. Whereas adding on-farm and genomic information (M3 and M4) in multiple kernel learning showed greater bias than M1 for many of the fraction traits, the extent of bias was smaller in multilayer BayesB.

Fig. 4.

Fig. 4

Prediction R-squared for milk protein traits (TP: true protein nitrogen; TCN: total casein; TWP: total whey protein; κ-CN: κ-casein; β-CN: β-casein; αS1-CN: αS1-casein; αS2-CN: αS2-casein; β-LG: β-lactoglobulin; α-LA: α-lactalbumin) from multiple kernel learning using herd cross-validation. S: spectral relationship matrix; G: genomic relationship matrix; A: numerator relationship matrix; DIM: days in milk; Top3SNP: top three markers with the largest effects.

Fig. 5.

Fig. 5

Prediction R-squared for milk protein traits (TP: true protein nitrogen; TCN: total casein; TWP: total whey protein; κ-CN: κ-casein; β-CN: β-casein; αS1-CN: αS1-casein; αS2-CN: αS2-casein; β-LG: β-lactoglobulin; α-LA: α-lactalbumin) from multilayer BayesB using herd cross-validation. FTIR: milk Fourier transform infrared spectroscopy; DIM: days in milk.

Fig. 6.

Fig. 6

Prediction R-squared for milk protein traits (TP: true protein nitrogen; TCN: total casein; TWP: total whey protein; κ-CN: κ-casein; β-CN: β-casein; αS1-CN: αS1-casein; αS2-CN: αS2-casein; β-LG: β-lactoglobulin; α-LA: α-lactalbumin) from partial least squares using herd cross-validation. FTIR: milk Fourier transform infrared spectroscopy; G: Principal components of genomic relationship matrix; A: Principal components of numerator relationship matrix; DIM: days in milk.

Table 4.

Regression coefficients of predictive value for testing cows on phenotype when fitting multiple kernel learning, multilayer BayesB, and partial least squares (PLS) using herd cross-validation

Traits Kernel BayesB PLS
M1 M3 M4 M5 M6 M7 M1 M3 M4 M1 M3 M4 M7
True protein nitrogen 0.90 0.89 0.88 0.88 0.87 0.90 0.84 0.86 0.87 0.30 0.31 0.28 0.29
Total casein 0.96 0.96 0.96 0.96 0.95 0.96 0.89 0.92 0.91 0.75 0.74 0.62 0.58
Total whey protein 0.71 0.69 0.64 0.68 0.74 0.74 0.73 0.77 0.74 0.06 0.05 0.08 0.07
κ-casein 0.83 0.79 0.84 0.94 0.94 0.77 0.79 0.80 0.93 0.14 0.14 0.15 0.05
β-casein 0.96 0.77 0.82 0.97 0.96 0.92 0.86 0.88 0.95 0.21 0.18 0.26 0.13
αS1-casein 0.84 0.68 0.71 0.77 0.83 0.85 0.79 0.85 0.90 0.12 0.10 0.13 0.12
αS2-casein 0.78 0.70 0.74 0.68 0.73 0.77 0.77 0.75 0.84 0.08 0.09 0.10 0.07
β-lactoglobulin 0.75 0.71 0.64 0.68 0.74 0.75 0.78 0.78 0.81 0.07 0.07 0.08 0.08
α-lactalbumin 0.91 0.92 0.94 0.84 0.82 0.88 0.80 0.87 0.84 0.22 0.22 0.22 0.22

M1: milk Fourier transform infrared spectroscopy (FTIR)

M3: days in milk (DIM)+ parity + FTIR

M4: DIM + parity + FTIR + genomics

M5: DIM + parity + FTIR + top three markers with the largest effects

M6: herd + DIM + parity + FTIR + genomics + top three markers with the largest effects

M7: herd + DIM + parity + FTIR + pedigree

Discussion

Predictive ability across dairy farms

Repeated random sub-sampling or k-fold CV has often been used to evaluate a calibration equation in spectral analysis. However, the R2 derived from this type of CV may be over-optimistic as the records from the same herds could be included in both training and testing data [7, 11]. For instance, Wang and Bovenhuis [7] found that the R2 for CH4 emission was small when it was obtained from milk FTIR spectra using a CV scheme based on herds. In contrast, a moderate R2 was observed for k-fold CV. In addition, Luke et al. [8] showed that prediction for serum metabolic concentrations was lower with herd CV than with k-fold CV. In our study, the R2 from herd CV was lower than that obtained using repeated random sub-sampling CV. In routine evaluations, the use of herd CV must be carefully considered before developing a calibration model because repeated random subsampling or k-fold CV may provide over-optimistic predictions. Our herd CV results suggest that the use of genomic and pedigree information can be beneficial whereas on-farm information adds relatively less value.

Integration of heterogeneous data

There is growing interest in exploiting multiple sources of information to perform spectral-based predictions of novel phenotypes [11, 19]. We analyzed the impact of using on-farm (herd, DIM, and parity), genomic, and pedigree information on forecasting milk protein composition. To this end, we applied multiple kernel learning and multilayer BayesB. Some previous studies investigated the predictive performance for milk protein composition expressed as g/L or g/dL of milk based on k-fold cross-validation using spectra alone. For example, Bonfatti et al. [13] and Rutten et al. [16] obtained low to moderate R2 values that ranged from 0.31 to 0.78 and from 0.18 to 0.56, respectively. Bonfatti et al. [13, 29] reported that the R2 values for milk protein composition expressed as g/L were higher than those for percentage protein. Our prediction of unit of total N content in the casein fractions using milk FTIR spectra showed lower R2, ranging from 0.11 to 0.50 for repeated random sub-sampling CV and from 0.06 to 0.43 for herd CV. However, we found higher R2 values for total casein (0.79 to 0.82 in repeated random sub-sampling CV; 0.73 to 0.76 in herd CV) than for the other traits evaluated. Hence, milk FTIR spectral information might suffice to predict total casein.

On-farm information plus milk FTIR spectra produced higher R2 than that of the model with milk FTIR spectra alone in repeated random sub-sampling CV. In contrast, the results for herd CV showed only minor improvements relative to the milk FTIR spectra model. Therefore, the inclusion of these explanatory predictors may only be effective when they are applied to the same herds. We found no prior literature integrating milk FTIR spectra with on-farm data to predict milk protein components. Recent studies assessed the contribution of on-farm information to predict reproductive traits [10, 11]. In repeated random sub-sampling CV, adding the herd effect enhanced the prediction more effectively than adding DIM or parity. This finding was consistent with that of a previous study [10]. Indeed, Toledo-Alvarado et al. [10] reported that joint DIM, parity, and milk FTIR spectra modeling did not improve the prediction of pregnancy status as compared to the model with milk FTIR spectra alone. The inclusion of herd and year only slightly improved predictions. Here, the herd effect was the most influential of all the on-farm predictors. The herd effect may account for differences in feeding systems and management between dairy herds. Nevertheless, as practical applications often require predictions across dairy farms [12], herd CV was also used to evaluate a more realistic scenario in routine evaluations. In this case, on-farm information such as herd, DIM, and parity may be excluded from the prediction model.

The inclusion of whole-genome and/or top markers with large effects provided greater predictions for both the kernel methods and BayesB, especially for κ-CN and β-CN. Genotype data increased R2 possibly because of the high heritability of these traits. Pegolo et al. [22] reported genomic heritability estimates of 0.83 and 0.68 for κ-CN and β-CN, respectively. These estimates were higher than those for other milk composition traits, ranging from 0.13 to 0.66. Our kernel methods showed that R2 was higher for some traits when the top three markers were incorporated. Hence, these quantitative trait loci have a strong influence. Pegolo et al. [22] identified significant SNPs on chromosomes 6 and 11 for milk protein fractions. Within the two CV, we found the same markers as in Pegolo et al. [22] for κ-CN and β-CN using multiple kernel learning, while multilayer BayesB further identified common markers associated with TWP, α-LA, αS1-CN, and αS2-CN. The observed improvement in predictive performance of BayesB for all traits may have been the result of effectively distinguishing SNPs or spectra with large effects from those with small effects. Recent studies reported that including genomic information influences prediction positively. Wang and Bovenhuis [19] obtained comparatively better predictions for milk fat component traits when they combined milk FTIR data and three polymorphisms of the diacylglycerol acyltransferase 1 (DGAT1) K232A, stearoyl-CoA desaturase 1 (SCD1) A293V, and fatty acid synthase (FASN) genes. Ho et al. [11] showed that the addition of genomic signals such as principal components calculated from a genomic relationship matrix and fertility genomic estimated breeding values to spectral data enhances the prediction of conception at first insemination. Therefore, integrating genotype information or including markers with large effects with milk FTIR spectra might improve the prediction of certain traits.

There may be a limited number of females with genotype information, as most of them are genotyped for genomic selection purposes only. For this reason, we investigated the combination of pedigree data with milk FTIR spectral information via a numerator relationship matrix. This approach yielded R2 similar to or lower than those obtained from the genomic relationship matrix. Nevertheless, for some traits such as TWP, κ-CN, and αS1-CN, the predictive performance including pedigree information was slightly better (higher R2) than that obtained using milk FTIR or on-farm data alone. Therefore, leveraging pedigree information is a feasible alternative when genotype information is not available.

Comparison of multiple kernel learning and multilayer BayesB to PLS

We compared kernel methods, BayesB, and PLS in terms of their effectiveness in including heterogeneous information for the phenotypic prediction of different milk protein component traits. The model with milk FTIR spectra alone served as the reference baseline. For both CV scenarios, the kernel methods and BayesB had similar predictive performance compared to PLS using only spectral information for non-fraction traits. However, BayesB delivered relatively better results for many of the fraction traits. Compared to multiple kernel learning and PLS, multilayer BayesB also showed better predictions when either on-farm data or both on-farm data and genomic information plus milk FTIR spectra were used. Ferragina et al. [5] reported superior predictive performance for BayesB compared with Bayesian ridge regression, BayesA, and PLS when milk FTIR spectral information was used. Bonfatti et al. [29] reported that R2 for milk protein fractions (g/L of milk) such as TWP, β-CN, and αS1-CN derived from BayesB and BayesC, using spectral data alone, showed slightly better prediction than that of PLS. However, the differences were small. Our results generally corroborated their findings and further demonstrated that multilayer BayesB can be a useful tool to integrate heterogeneous data. This discovery is consistent with recent studies in which multilayer Bayesian regression models were applied to integrate genomics, transcriptomics, or methylation data [30, 31]. As described earlier, BayesB is a variable selection method that distinguishes predictors with large effects from those with small effects. Numerous FTIR spectrum regions may have marginal effects on a target trait [5]. Thus, BayesB can effectively identify the wavenumber ranges with large effects on the traits of interest.

To the best of our knowledge, this is the first study to apply multiple kernel learning for phenotypic prediction based on the construction of a spectral relationship matrix among individuals according to their milk FTIR spectral profiles. The advantage of kernel methods is that they can accommodate multiple sources of information provided that the kernels can be constructed from each information set [23]. An important example is a genomic relationship matrix embedding the genomic profiles of individuals. However, the construction of kernels does not preclude using non-genomic sources. For instance, Hu et al. [32] developed a relationship matrix among Arabidopsis thaliana lines based on their methylation profiles to conduct methylation-based phenotypic prediction. Krause et al. [33] used a hyperspectral reflectance relationship matrix from hyperspectral bands in wheat to predict grain yield. Li et al. [34] applied a transcriptomic-based relationship matrix among Drosophila melanogaster lines using tiling arrays to predict nine traits including startle responses. In our study, kernel methods were extended to accommodate milk FTIR spectral data. Overall, kernel methods showed a lower predictive performance than that of BayesB. This might be attributed to the fact that kernel methods assume a common wavenumber variance whereas BayesB performs variable selection. Therefore, using a weighted spectral relationship matrix by putting a prior weight to each individual wavenumber (if available) may enhance prediction. However, kernel methods offer a straightforward avenue to integrate additive genetic effects based on pedigree (i.e., numerator relationship matrix).

When genomic or pedigree information was added, the prediction R2 values for PLS decreased for numerous traits. It is likely that this occurred because the standard PLS widely used in spectra analysis does not clearly differentiate between contributions from genomics/pedigree and milk FTIR spectra. We also explored predictive performance using the pre-treatment data because using derivative milk spectra or removing noisy spectra regions may improve prediction performance [3]. In fact, the use of informative spectra led to an increase in R2 values for all the traits compared to the use of non-treated spectra, however, prediction performance did not improve greatly when genomic or pedigree data were included. As stated earlier, multiple kernel learning and multilayer BayesB can better accommodate multiple heterogeneous data than PLS for a prediction purpose. The PLS method maximizes variance conditional on the response variable regardless of the source of predictors. Further studies are warranted to improve the predictive ability of PLS in the context of data integration.

Conclusions

This study investigated the effectiveness of kernel methods, BayesB, and PLS at integrating heterogeneous data including milk FTIR spectral, on-farm, genomic, and pedigree data for predicting milk protein traits. Multiple kernel learning and multilayer BayesB can potentially improve milk protein trait prediction performance by correctly assigning different weights or priors for genetic (genomic or pedigree) and milk FTIR spectral components. In particular, multilayer BayesB was identified as the best predictive model. The present study provides alternative statistical methods for spectra-based predictions.

Acknowledgements

The authors would like to thank Haipeng Yu and Mehdi Momen for the helpful comments and discussion on the research.

Authors’ contributions

TB performed the data analysis and interpreted the results. TB and GM conceived the idea and wrote the manuscript. SP, LFMM, FP, GB, and AC discussed the results and revised the manuscript. GM supervised and directed the study. All authors read and approved the final manuscript.

Funding

This work was supported in part by Virginia Polytechnic Institute and State University startup funds to GM.

Availability of data and materials

The data analyzed are available from the corresponding author on reasonable request.

Declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Footnotes

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Contributor Information

Toshimi Baba, Email: tbaba@vt.edu.

Sara Pegolo, Email: sara.pegolo@unipd.it.

Lucio F. M. Mota, Email: flaviommota.zoo@gmail.com

Francisco Peñagaricano, Email: fpenagarican@wisc.edu.

Giovanni Bittante, Email: bittante@unipd.it.

Alessio Cecchinato, Email: alessio.cecchinato@unipd.it.

Gota Morota, Email: morota@vt.edu.

References

  • 1.Morota G, Ventura RV, Silva FF, Koyama M, Fernando SC. Machine learning and data mining advance predictive big data analysis in precision animal agriculture. J Anim Sci. 2018;96:1540–1550. doi: 10.1093/jas/sky014. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Ferragina A, Cipolat-Gotet C, Cecchinato A, Bittante G. The use of Fourier-transform infrared spectroscopy to predict cheese yield and nutrient recovery or whey loss traits from unprocessed bovine milk samples. J Dairy Sci. 2013;96:7980–7990. doi: 10.3168/jds.2013-7036. [DOI] [PubMed] [Google Scholar]
  • 3.De Marchi M, Toffanin V, Cassandro M, Penasa M. Invited review: mid-infrared spectroscopy as phenotyping tool for milk traits. J Dairy Sci. 2014;97(3):1171–1186. doi: 10.3168/jds.2013-6799. [DOI] [PubMed] [Google Scholar]
  • 4.Gengler N, Soyeurt H, Dehareng F, Bastin C, Colinet F, Hammami H, Vanrobays M-L, Lainé A, Vanderick S, Grelet C, et al. Capitalizing on fine milk composition for breeding and management of dairy cows. J Dairy Sci. 2016;99(5):4071–4079. doi: 10.3168/jds.2015-10140. [DOI] [PubMed] [Google Scholar]
  • 5.Ferragina A, de Los Campos G, Vazquez A, Cecchinato A, Bittante G. Bayesian regression models outperform partial least squares methods for predicting milk components and technological properties using infrared spectral data. J Dairy Sci. 2015;98(11):8133–8151. doi: 10.3168/jds.2014-9143. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Smith S, Denholm S, Coffey M, Wall E. Energy profiling of dairy cows from routine milk mid-infrared analysis. J Dairy Sci. 2019;102(12):11169–11179. doi: 10.3168/jds.2018-16112. [DOI] [PubMed] [Google Scholar]
  • 7.Wang Q, Bovenhuis H. Validation strategy can result in an overoptimistic view of the ability of milk infrared spectra to predict methane emission of dairy cattle. J Dairy Sci. 2019;102(7):6288–6295. doi: 10.3168/jds.2018-15684. [DOI] [PubMed] [Google Scholar]
  • 8.Luke T, Rochfort S, Wales W, Bonfatti V, Marett L, Pryce J. Metabolic profiling of early-lactation dairy cows using milk mid-infrared spectra. J Dairy Sci. 2019;102(2):1747–1760. doi: 10.3168/jds.2018-15103. [DOI] [PubMed] [Google Scholar]
  • 9.Laine A, Bastin C, Grelet C, Hammami H, Colinet F, Dale LM, Gillon A, Vandenplas J, Dehareng F, Gengler N. Assessing the effect of pregnancy stage on milk composition of dairy cows using mid-infrared spectra. J Dairy Sci. 2017;100(4):2863–2876. doi: 10.3168/jds.2016-11736. [DOI] [PubMed] [Google Scholar]
  • 10.Toledo-Alvarado H, Vazquez AI, de los Campos G, Tempelman RJ, Bittante G, Cecchinato A. Diagnosing pregnancy status using infrared spectra and milk composition in dairy cows. J Dairy Sci. 2018;101(3):2496–2505. doi: 10.3168/jds.2017-13647. [DOI] [PubMed] [Google Scholar]
  • 11.Ho P, Bonfatti V, Luke T, Pryce J. Classifying the fertility of dairy cows using milk mid-infrared spectroscopy. J Dairy Sci. 2019;102(11):10460–10470. doi: 10.3168/jds.2019-16412. [DOI] [PubMed] [Google Scholar]
  • 12.Bonfatti V, Ho P, Pryce J. Usefulness of milk mid-infrared spectroscopy for predicting lameness score in dairy cows. J Dairy Sci. 2020;103(3):2534–2544. doi: 10.3168/jds.2019-17551. [DOI] [PubMed] [Google Scholar]
  • 13.Bonfatti V, Di Martino G, Carnier P. Effectiveness of mid-infrared spectroscopy for the prediction of detailed protein composition and contents of protein genetic variants of individual milk of simmental cows. J Dairy Sci. 2011;94(12):5776–5785. doi: 10.3168/jds.2011-4401. [DOI] [PubMed] [Google Scholar]
  • 14.Cipolat-Gotet C, Cecchinato A, Malacarne M, Bittante G, Summer A. Variations in milk protein fractions affect the efficiency of the cheese-making process. J Dairy Sci. 2018;101(10):8788–8804. doi: 10.3168/jds.2018-14503. [DOI] [PubMed] [Google Scholar]
  • 15.Amalfitano N, Cipolat-Gotet C, Cecchinato A, Malacarne M, Summer A, Bittante G. Milk protein fractions strongly affect the patterns of coagulation, curd firming, and syneresis. J Dairy Sci. 2019;102(4):2903–2917. doi: 10.3168/jds.2018-15524. [DOI] [PubMed] [Google Scholar]
  • 16.Rutten M, Bovenhuis H, Heck J, Van Arendonk J. Predicting bovine milk protein composition based on Fourier transform infrared spectra. J Dairy Sci. 2011;94(11):5683–5690. doi: 10.3168/jds.2011-4520. [DOI] [PubMed] [Google Scholar]
  • 17.Cecchinato A, De Marchi M, Gallo L, Bittante G, Carnier P. Mid-infrared spectroscopy predictions as indicator traits in breeding programs for enhanced coagulation properties of milk. J Dairy Sci. 2009;92(10):5304–5313. doi: 10.3168/jds.2009-2246. [DOI] [PubMed] [Google Scholar]
  • 18.Cecchinato A, Toledo-Alvarado H, Pegolo S, Rossoni A, Santus E, Maltecca C, Bittante G, Tiezzi F. Integration of wet-lab measures, milk infrared spectra, and genomics to improve difficult-to-measure traits in dairy cattle populations. Front Genet. 2020;11:1131. doi: 10.3389/fgene.2020.563393. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Wang Q, Bovenhuis H. Combined use of milk infrared spectra and genotypes can improve prediction of milk fat composition. J Dairy Sci. 2020;103(3):2514–2522. doi: 10.3168/jds.2019-16784. [DOI] [PubMed] [Google Scholar]
  • 20.Wold S, Sjöström M, Eriksson L. Pls-regression: a basic tool of chemometrics. Chemometr Intell Lab Syst. 2001;58(2):109–130. doi: 10.1016/S0169-7439(01)00155-1. [DOI] [Google Scholar]
  • 21.Bonfatti V, Grigoletto L, Cecchinato A, Gallo L, Carnier P. Validation of a new reversed-phase high-performance liquid chromatography method for separation and quantification of bovine milk protein genetic variants. J Chromatogr A. 2008;1195(1–2):101–106. doi: 10.1016/j.chroma.2008.04.075. [DOI] [PubMed] [Google Scholar]
  • 22.Pegolo S, Mach N, Ramayo-Caldas Y, Schiavon S, Bittante G, Cecchinato A. Integration of gwas, pathway and network analyses reveals novel mechanistic insights into the synthesis of milk proteins in dairy cows. Sci Rep. 2018;8(1):1–15. doi: 10.1038/s41598-017-17765-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Morota G, Gianola D. Kernel-based whole-genome prediction of complex traits: a review. Front Genet. 2014;5:363. doi: 10.3389/fgene.2014.00363. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.VanRaden PM. Efficient methods to compute genomic predictions. J Dairy Sci. 2008;91(11):4414–4423. doi: 10.3168/jds.2007-0980. [DOI] [PubMed] [Google Scholar]
  • 25.Meuwissen T, Hayes B, Goddard M. Prediction of total genetic value using genome-wide dense marker maps. Genetics. 2001;157(4):1819–1829. doi: 10.1093/genetics/157.4.1819. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Perez P, de los Campos G. Genome-wide regression and prediction with the bglr statistical package. Genetics. 2014;198(2):483–495. doi: 10.1534/genetics.114.164442. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Rohart F, Gautier B, Singh A, Lê Cao K-A. mixomics: an r package for ’omics feature selection and multiple data integration. PLoS Comput Biol. 2017;13(11):1005752. doi: 10.1371/journal.pcbi.1005752. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Nani JP, Rezende FM, Peñagaricano F. Predicting male fertility in dairy cattle using markers with large effect and functional annotation data. BMC Genomics. 2019;20(1):258. doi: 10.1186/s12864-019-5644-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Bonfatti V, Tiezzi F, Miglior F, Carnier P. Comparison of Bayesian regression models and partial least squares regression for the development of infrared prediction equations. J Dairy Sci. 2017;100(9):7306–7319. doi: 10.3168/jds.2016-12203. [DOI] [PubMed] [Google Scholar]
  • 30.Vazquez AI, Veturi Y, Behring M, Shrestha S, Kirst M, Resende MF, de los Campos G. Increased proportion of variance explained and prediction accuracy of survival of breast cancer patients with use of whole-genome multiomic profiles. Genetics. 2016;203(3):1425–1438. doi: 10.1534/genetics.115.185181. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Roudbar MA, Mohammadabadi MR, Mehrgardi AA, Abdollahi-Arpanahi R, Momen M, Morota G, Lopes FB, Gianola D, Rosa GJ. Integration of single nucleotide variants and whole-genome dna methylation profiles for classification of rheumatoid arthritis cases from controls. Heredity. 2020;124(5):658–674. doi: 10.1038/s41437-020-0301-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Hu Y, Morota G, Rosa GJ, Gianola D. Prediction of plant height in Arabidopsis thaliana using DNA methylation data. Genetics. 2015;201(2):779–793. doi: 10.1534/genetics.115.177204. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Krause MR, González-Pérez L, Crossa J, Pérez-Rodríguez P, Montesinos-López O, Singh RP, Dreisigacker S, Poland J, Rutkoski J, Sorrells M., et al. Hyperspectral reflectance-derived relationship matrices for genomic prediction of grain yield in wheat. G3 Genes Genomes Genet. 2019;9(4):1231–1247. doi: 10.1534/g3.118.200856. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Li Z, Simianer H, Martini JW, et al. Integrating gene expression data into genomic prediction. Front Genet. 2019;10:126. doi: 10.3389/fgene.2019.00126. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The data analyzed are available from the corresponding author on reasonable request.


Articles from Genetics, Selection, Evolution : GSE are provided here courtesy of BMC

RESOURCES