Table 7.
Results of disparities among age and sex in each evaluation metric for AD detection using brain MRI.
Train-time aug. | Test-time aug. | Age disparity |
||||
---|---|---|---|---|---|---|
AUC | BCE | ECE | Error rate | Precision | ||
w/o | w/o | 0.209 | 0.322 | 0.109 | 0.273 | 0.428 |
w/o | w/ | 0.251 | 0.109 | 0.024 | 0.173 | 0.226 |
w/ | w/o | 0.163 | 0.253 | 0.070 | 0.128 | 0.095 |
w/ | w/ | 0.170 | 0.038 | 0.012 | 0.151 | 0.107 |
Sex disparity | ||||||
w/o | w/o | 0.247 | 0.369 | 0.033 | 0.258 | 0.373 |
w/o | w/ | 0.138 | 0.038 | 0.062 | 0.124 | 0.182 |
w/ | w/o | 0.065 | 0.076 | 0.042 | 0.178 | 0.156 |
w/ | w/ | 0.064 | 0.055 | 0.100 | 0.168 | 0.144 |
The high disparities of the model indicate inequitable predictions. The minimum values are highlighted in bold.