Table 4.
Performance of X-ray and MRI architectures on test data. While integrated X-ray pipeline delivers higher accuracy than integrated MRI pipeline, integrated MRI pipeline yields improved sensitivity over integrated X-ray pipeline across all stages of OA, markedly so at no OA. Standard errors used to calculate confidence intervals.
OA status | Image source | Model type | Accuracy (95% CI) | Sensitivity (95% CI) | Specificity (95% CI) | Non-TKR cases | TKR cases |
---|---|---|---|---|---|---|---|
None | X-ray | Non-imaging info. only | 89.1 ± 0.139 | 49.7 ± 2.80 | 89.3 ± 0.140 | 2,892 | 12 |
Image only | 95.0 ± 0.089 | 7.8 ± 1.64 | 95.4 ± 0.089 | ||||
Integrated model | 95.4 ± 0.081 | 8.6 ± 1.95 | 95.8 ± 0.077 | ||||
MRI | Non-imaging info. only | 89.1 ± 0.139 | 49.7 ± 2.80 | 89.3 ± 0.140 | |||
Image only | 95.2 ± 0.088 | 66.9 ± 3.23 | 95.3 ± 0.089 | ||||
Integrated model | 82.4 ± 0.171 | 92.2 ± 1.68 | 82.4 ± 0.173 | ||||
Moderate | X-ray | Non-imaging info. only | 72.9 ± 0.208 | 70.0 ± 1.16 | 73.0 ± 0.212 | 2,056 | 83 |
Image only | 79.9 ± 0.196 | 66.7 ± 1.23 | 80.4 ± 0.195 | ||||
Integrated model | 81.4 ± 0.178 | 76.0 ± 1.12 | 81.6 ± 0.179 | ||||
MRI | Non-imaging info. only | 72.9 ± 0.208 | 70.0 ± 1.16 | 73.0 ± 0.212 | |||
Image only | 68.8 ± 0.225 | 78.3 ± 0.952 | 68.4 ± 0.227 | ||||
Integrated model | 74.9 ± 0.216 | 78.9 ± 0.974 | 74.7 ± 0.228 | ||||
Severe | X-ray | Non-imaging info. only | 51.3 ± 0.744 | 89.4 ± 0.864 | 35.8 ± 0.925 | 141 | 57 |
Image only | 32.1 ± 0.714 | 94.5 ± 0.735 | 7.2 ± 0.467 | ||||
Integrated model | 60.5 ± 0.775 | 64.0 ± 1.57 | 59.0 ± 0.959 | ||||
MRI | Non-imaging info. only | 51.3 ± 0.744 | 89.4 ± 0.864 | 35.8 ± 0.925 | |||
Image only | 34.6 ± 0.775 | 98.3 ± 0.390 | 9.2 ± 0.632 | ||||
Integrated model | 59.6 ± 0.770 | 84.0 ± 1.03 | 49.6 ± 1.04 | ||||
All | X-ray | Non-imaging info. only | 81.1 ± 0.118 | 75.6 ± 0.776 | 81.2 ± 0.122 | 5,089 | 152 |
Image only | 86.4 ± 0.095 | 72.5 ± 0.864 | 86.9 ± 0.095 | ||||
Integrated model | 88.4 ± 0.094 | 66.3 ± 0.924 | 89.1 ± 0.090 | ||||
MRI | Non-imaging info. only | 81.1 ± 0.118 | 75.6 ± 0.776 | 81.2 ± 0.122 | |||
Image only | 82.1 ± 0.118 | 84.9 ± 0.636 | 82.1 ± 0.119 | ||||
Integrated model | 78.5 ± 0.134 | 81.8 ± 0.643 | 78.4 ± 0.138 |