Table 8.
Linear calibration measures of the models with the lowest test mean absolute error for each validation method.
Measure | Validation method | ||
|
In-distribution | Out-of-distribution | Cross-validation |
Test sample size, n | 2847 | 2811 | 19,669 |
Model | Random forest | AdaBoosta | AdaBoost |
Correlation, r | 0.979 | 0.716 | 0.758 |
Slope (SE) | 1.037 (0.004) | 0.986 (0.018) | 0.968 (0.006) |
Slope standardized mean difference (z score) from 1 | 0.176 | –0.015 | –0.039 |
Slope P value (mean of 1) | <.001 | .43 | <.001 |
Intercept (SE) | –0.013 (0.002) | –0.011 (0.004) | 0.006 (0.003) |
Intercept standardized mean difference (z score) from 0 | –0.119 | –0.044 | 0.014 |
Intercept P value (mean of 0) | <.001 | .02 | .06 |
R2 value | 0.959 | 0.513 | 0.574 |
aAdaBoost: adaptive boosting.