Table 1.
Model accuracy on evaluation dataset (30% independent data) using AUC. (Standard deviations (±) indicate the variability of model accuracy through 100 iterations. AUC values for models calibrated in Europe (EU), North America (NA) and both (EU+NA) are indicated for each modelling technique. The differences in model accuracy between ranges within and between models were tested with a paired Wilcoxon signed-rank test (n.s., not significant; *0.05<p<1×10−5; **p<1×10−5).)
calibration in EU | ↔ | calibration in EU+NA | ↔ | calibration in NA | |||||||
---|---|---|---|---|---|---|---|---|---|---|---|
NA | ↔ | EU | EU | ↔ | NA | NA | ↔ | EU | |||
GLM | 0.77±0.07 | ** | 0.87±0.03 | n.s. | 0.86±0.03 | ** | 0.96±0.01 | n.s. | 0.96±0.01 | ** | 0.73±0.04 |
GAM | 0.89±0.05 | * | 0.88±0.03 | n.s. | 0.87±0.03 | ** | 0.96±0.01 | n.s. | 0.96±0.01 | ** | 0.70±0.04 |
GBM | 0.85±0.02 | ** | 0.89±0.03 | n.s. | 0.88±0.03 | ** | 0.96±0.01 | n.s. | 0.97±0.01 | ** | 0.76±0.04 |
RF | 0.84±0.03 | ** | 0.90±0.02 | n.s. | 0.90±0.03 | ** | 0.97±0.01 | n.s. | 0.98±0.01 | ** | 0.76±0.03 |