TABLE 6.
Results for the case study on coronary artery disease (CAD)
| Performance statistic | MLR | CL‐PO | AC‐PO | CR‐PO | CR‐NP | SLM |
|---|---|---|---|---|---|---|
| Apparent performance | ||||||
| Calibration intercepts and slopes per outcome category | ||||||
| 1 (No CAD) | 0.00/1.00 | −0.02/1.13 | 0.00/1.38 | 0.00/1.48 | 0.00/1.00 | 0.00/1.00 |
| 2 (Nonobstructive stenosis) | 0.00/1.06 | 0.00/0.82 | 0.00/0.63 | −0.04/0.65 | 0.00/1.09 | 0.00/1.16 |
| 3 (One‐vessel disease) | 0.00/0.97 | 0.02/0.82 | 0.00/1.11 | 0.03/1.08 | 0.00/0.93 | 0.00/0.96 |
| 4 (Two‐vessel disease) | 0.00/1.02 | 0.01/1.06 | 0.00/1.04 | 0.06/1.20 | 0.00/1.04 | 0.00/1.03 |
| 5 (Three‐vessel disease) | 0.00/0.98 | 0.00/0.89 | 0.00/0.70 | −0.02/0.61 | 0.00/0.98 | 0.00/0.98 |
| Calibration intercepts and slopes per outcome dichotomy | ||||||
| 2‐5 vs 1 | 0.00/1.00 | 0.02/1.13 | 0.00/1.38 | 0.00/1.48 | 0.00/1.00 | 0.00/1.00 |
| 3‐5 vs 1‐2 | 0.00/0.99 | 0.02/0.91 | 0.00/0.94 | 0.04/0.99 | 0.00/1.00 | 0.00/1.00 |
| 4‐5 vs 1‐3 | 0.00/1.00 | 0.00/0.95 | 0.00/0.83 | 0.03/0.83 | 0.00/1.01 | 0.00/1.00 |
| 5 vs 1‐4 | 0.00/0.98 | 0.00/0.89 | 0.00/0.70 | −0.02/0.61 | 0.00/0.98 | 0.00/0.98 |
| Calibration intercepts and slopes, model‐specific | ||||||
| Linear predictor 1 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 |
| Linear predictor 2 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 |
| Linear predictor 3 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 |
| Linear predictor 4 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 | 0.00/1.00 |
| ECI | 0.005 | 0.030 | 0.141 | 0.194 | 0.005 | 0.004 |
| ORC | 0.696 | 0.695 | 0.695 | 0.695 | 0.695 | 0.694 |
| Bootstrap‐corrected performance | ||||||
| Calibration intercepts and slopes per outcome category | ||||||
| 1 (No CAD) | 0.00/0.99 | −0.02/1.12 | 0.00/1.37 | 0.00/1.47 | 0.00/0.98 | 0.00/0.99 |
| 2 (Nonobstructive stenosis) | 0.00/0.99 | −0.01/0.81 | 0.00/0.62 | −0.04/0.64 | 0.00/1.02 | 0.00/1.13 |
| 3 (One‐vessel disease) | 0.00/0.89 | 0.02/0.80 | 0.00/1.09 | 0.03/1.06 | 0.00/0.86 | 0.00/0.95 |
| 4 (Two‐vessel disease) | 0.00/0.97 | 0.01/1.05 | 0.00/1.02 | 0.06/1.17 | 0.00/0.97 | 0.00/1.03 |
| 5 (Three‐vessel disease) | 0.00/0.94 | 0.01/0.87 | 0.01/0.68 | 0.00/0.60 | 0.01/0.93 | 0.00/0.98 |
| Calibration intercepts and slopes per outcome dichotomy | ||||||
| 2‐5 vs 1 | 0.00/0.99 | 0.02/1.12 | 0.00/1.37 | 0.00/1.47 | 0.00/0.98 | 0.00/0.99 |
| 3‐5 vs 1‐2 | 0.00/0.98 | 0.02/0.90 | 0.00/0.93 | 0.04/0.98 | 0.00/0.98 | 0.00/0.99 |
| 4‐5 vs 1‐3 | 0.00/0.97 | 0.01/0.93 | 0.01/0.81 | 0.03/0.81 | 0.01/0.98 | 0.00/1.00 |
| 5 vs 1‐4 | 0.00/0.94 | 0.01/0.87 | 0.01/0.68 | 0.00/0.60 | 0.01/0.93 | 0.00/0.98 |
| Calibration intercepts and slopes, model‐specific | ||||||
| Linear predictor 1 | 0.00/0.95 | 0.00/0.99 | 0.00/0.98 | 0.00/0.98 | 0.00/0.98 | −0.01/0.99 |
| Linear predictor 2 | 0.00/0.96 | 0.00/0.99 | 0.00/0.98 | 0.00/0.98 | 0.00/0.96 | 0.00/0.98 |
| Linear predictor 3 | 0.01/0.96 | −0.01/0.99 | 0.00/0.98 | 0.01/0.98 | 0.01/0.89 | 0.00/0.99 |
| Linear predictor 4 | 0.00/0.96 | −0.01/0.99 | 0.01/0.98 | 0.01/0.98 | 0.01/0.65 | 0.00/0.99 |
| ORC | 0.694 | 0.693 | 0.693 | 0.693 | 0.693 | 0.693 |
Abbreviations: AC‐PO, adjacent category logit model with proportional odds; CAD, coronary artery disease; CL‐PO, cumulative logit model with proportional odds; ECI, estimated calibration index; LP, linear predictor; MLR, multinomial logistic regression; ORC, ordinal C statistic; rMSPE, root mean squared prediction error; SLM, stereotype logit model.