Skip to main content
. 2023 Nov 10;39(12):btad680. doi: 10.1093/bioinformatics/btad680

Table 3.

Predictive performance in external simulation.a

transreg
K a h α Family ρ¯x max(ρ^β) glmnet glmtrans xrnet exp.sta exp.sim iso.sta iso.sim
1 5 0 Gaussian 0.01 1.00 73.2 ± 3.0 43.9 ± 9.2* 47.1 ± 1.8* 32.2 ± 3.2* 30.9 ± 2.8* 24.5 ± 3.6* 23.4 ± 3.3*
3 5 0 Gaussian 0.01 1.00 73.2 ± 3.0 33.5 ± 6.5* 29.3 ± 2.4* 18.1 ± 2.5* 16.7 ± 2.0* 13.5 ± 2.0* 12.7 ± 1.6*
5 5 0 Gaussian 0.01 1.00 73.2 ± 3.0 24.0 ± 3.7* 22.6 ± 1.5* 14.2 ± 1.7* 13.2 ± 1.7* 10.6 ± 1.0* 10.0 ± 0.9*
1 250 0 Gaussian 0.01 0.40 73.2 ± 3.0 31.8 ± 9.4* 63.8 ± 3.6* 54.8 ± 6.0* 57.8 ± 6.5* 49.5 ± 6.9* 50.0 ± 7.3*
3 250 0 Gaussian 0.01 0.42 73.2 ± 3.0 33.3 ± 8.2* 51.4 ± 4.7* 46.5 ± 7.9* 47.0 ± 9.2* 39.4 ± 6.5* 37.6 ± 7.5*
5 250 0 Gaussian 0.01 0.43 73.2 ± 3.0 33.3 ± 5.0* 43.4 ± 3.4* 40.0 ± 6.3* 39.2 ± 7.3* 32.7 ± 4.4* 30.0 ± 4.7*
1 5 1 Gaussian 0.01 1.00 17.3 ± 3.8 12.5 ± 1.4* 14.6 ± 1.7 12.2 ± 1.9* 14.7 ± 1.9* 11.0 ± 1.6* 11.6 ± 1.6*
3 5 1 Gaussian 0.01 1.00 17.3 ± 3.8 10.5 ± 0.7* 11.5 ± 0.6* 10.8 ± 0.6* 11.7 ± 1.6* 9.8 ± 0.5* 9.9 ± 0.6*
5 5 1 Gaussian 0.01 1.00 17.3 ± 3.8 10.0 ± 0.4* 11.0 ± 0.6* 10.5 ± 0.5* 11.1 ± 1.3* 9.6 ± 0.3* 9.8 ± 0.4*
1 250 1 Gaussian 0.01 0.24 17.3 ± 3.8 22.2 ± 13.4 17.6 ± 4.1 14.7 ± 3.4* 17.8 ± 4.8 14.7 ± 3.4* 18.2 ± 5.0
3 250 1 Gaussian 0.01 0.27 17.3 ± 3.8 19.8 ± 6.7 17.7 ± 3.6 14.7 ± 3.4* 18.4 ± 4.8 14.8 ± 3.4* 18.7 ± 5.5
5 250 1 Gaussian 0.01 0.27 17.3 ± 3.8 19.8 ± 6.7 17.5 ± 3.6 14.8 ± 3.3* 19.0 ± 4.6 14.7 ± 3.5* 21.3 ± 6.6
1 5 0 Binomial 0.01 1.00 91.5 ± 1.5 91.0 ± 4.2 84.5 ± 1.0* 82.4 ± 5.6* 82.7 ± 5.4* 77.8 ± 3.7* 78.5 ± 4.7*
3 5 0 Binomial 0.01 1.00 91.5 ± 1.5 85.9 ± 3.7* 75.9 ± 2.9* 69.8 ± 3.6* 70.0 ± 3.8* 66.7 ± 3.7* 66.6 ± 4.5*
5 5 0 Binomial 0.01 1.00 91.5 ± 1.5 79.9 ± 2.4* 70.8 ± 2.9* 63.1 ± 3.8* 63.2 ± 3.9* 61.2 ± 3.0* 62.2 ± 5.7*
1 250 0 Binomial 0.01 0.41 91.5 ± 1.5 92.0 ± 5.0 91.1 ± 2.0 89.4 ± 2.9* 90.2 ± 3.0 88.3 ± 3.2* 88.7 ± 3.0*
3 250 0 Binomial 0.01 0.42 91.5 ± 1.5 89.7 ± 4.3 86.5 ± 4.2* 86.3 ± 4.6* 87.8 ± 4.5* 84.0 ± 7.5* 84.2 ± 5.6*
5 250 0 Binomial 0.01 0.43 91.5 ± 1.5 85.3 ± 3.5* 83.0 ± 3.2* 84.3 ± 4.8* 85.9 ± 5.5* 79.4 ± 4.4* 79.0 ± 5.0*
1 5 1 Binomial 0.01 1.00 80.4 ± 8.2 77.8 ± 12.2 77.1 ± 8.4 71.4 ± 5.8* 73.0 ± 4.0* 70.3 ± 5.2* 72.4 ± 5.0*
3 5 1 Binomial 0.01 1.00 80.4 ± 8.2 70.5 ± 12.5* 69.5 ± 11.8* 67.9 ± 5.7* 70.8 ± 10.3* 64.7 ± 4.8* 64.4 ± 5.1*
5 5 1 Binomial 0.01 1.00 80.4 ± 8.2 59.5 ± 2.5* 64.4 ± 4.2* 65.7 ± 6.4* 65.5 ± 9.6* 62.7 ± 4.5* 61.8 ± 4.2*
1 250 1 Binomial 0.01 0.25 80.4 ± 8.2 82.1 ± 8.7 82.4 ± 9.9 81.5 ± 9.2 81.5 ± 9.1 81.2 ± 7.2 82.4 ± 10.1
3 250 1 Binomial 0.01 0.26 80.4 ± 8.2 80.5 ± 9.3 82.0 ± 8.8 80.7 ± 8.8 81.3 ± 9.5 79.2 ± 8.3 82.7 ± 11.2
5 250 1 Binomial 0.01 0.27 80.4 ± 8.2 78.9 ± 9.4* 84.6 ± 15.5 80.3 ± 8.3 83.4 ± 8.8 79.4 ± 10.7 86.3 ± 16.8
a

In each setting (row), we simulate 10 datasets, calculate the performance metric (mean-squared error for numerical prediction, logistic deviance for binary classification) for the test sets, express these metrics as percentages of those from prediction by the mean, and show the mean and standard deviation of these percentages. Settings: number of transferable source datasets (Ka), differences between source and target coefficients (h), dense setting with ridge regularization (s =50, α = 0) or sparse setting with lasso regularization (s =15, α = 1), family of distribution (‘gaussian’ or ‘binomial’). These parameters determine (i) the mean Pearson correlation among the features in the target dataset (ρ¯x) and (ii) the maximum Pearson correlation between the coefficients in the target dataset and the coefficients in the source datasets (max(ρ^β)). Methods: regularized regression (glmnet), competing transfer learning methods (glmtrans, xrnet), proposed transfer learning method (transreg) with exponential/isotonic calibration and standard/simultaneous stacking. In each setting, the colour black (grey) highlights methods that are more (less) predictive than regularized regression without transfer learning (glmnet), asterisks (daggers) indicate methods that are significantly more (less) predictive at the 5% level (one-sided Wilcoxon signed-rank test), and an underline highlights the most predictive method.