Table 3.
Fairness results
| Short model | Long model | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Sensitive attribute | Group | AUROC | TPR | FPR | EO | AUROC | TPR | FPR | EO |
| — | All patients | 0.78 (SD 0.02) | 0.80 (SD 0.05) | 0.25 (SD 0.02) | — | 0.80 SD (0.01) | 0.85 SD (0.04) | 0.25 SD (0.04) | — |
| Sex | Female | 0.74 (SD 0.18) | 0.79 (SD 0.35) | 0.29 (SD 0.13) | ✓ | 0.80 SD (0.15) | 0.85 SD (0.34) | 0.25 SD (0.10) | ✓ |
| Male | 0.80 (SD 0.08) | 0.82 (SD 0.22) | 0.23 (SD 0.06) | ✓ | 0.80 SD (0.16) | 0.84 SD (0.33) | 0.23 SD (0.08) | ✓ | |
| Age | 20 | 0.73 (SD 0.08) | 0.74 (SD 0.15) | 0.27 (SD 0.06) | ✓ | 0.76 SD (0.09) | 0.77 SD (0.16) | 0.24 SD (0.05) | ✓ |
| 30 | 0.80 (SD 0.02) | 0.86 (SD 0.06) | 0.26 (SD 0.04) | ✓ | 0.72 SD (0.03) | 0.64 SD (0.09) | 0.20 SD (0.05) | ✗ | |
| 40 | 0.78 (SD 0.04) | 0.81 (SD 0.08) | 0.25 (SD 0.03) | ✓ | 0.77 SD (0.02) | 0.80 SD (0.06) | 0.26 SD (0.06) | ✓ | |
| 50 | 0.76 (SD 0.04) | 0.78 (SD 0.09) | 0.25 (SD 0.04) | ✓ | 0.80 SD (0.04) | 0.87 SD (0.08) | 0.26 SD (0.05) | ✓ | |
| 60 | 0.79 (SD 0.02) | 0.82 (SD 0.04) | 0.23 (SD 0.04) | ✓ | 0.80 SD (0.03) | 0.84 SD (0.03) | 0.24 SD (0.05) | ✓ | |
| 70 | 0.73 (SD 0.08) | 0.69 (SD 0.19) | 0.23 (SD 0.07) | ✓ | 0.81 SD (0.06) | 0.86 SD (0.12) | 0.23 SD (0.05) | ✓ | |
| 80 | 0.77 (SD 0.02) | 0.81 (SD 0.04) | 0.26 (SD 0.03) | ✓ | 0.81 SD (0.01) | 0.85 SD (0.06) | 0.23 SD (0.05) | ✓ | |
| 90 | 0.78 (SD 0.03) | 0.79 (SD 0.07) | 0.23 (SD 0.02) | ✗ | 0.78 SD (0.02) | 0.78 SD (0.04) | 0.22 SD (0.04) | ✓ | |
| Race | Asian | 0.79 (SD 0.08) | 0.83 (SD 0.12) | 0.24 (SD 0.11) | ✓ | 0.80 SD (0.11) | 0.84 SD (0.18) | 0.24 SD (0.08) | ✓ |
| Black | 0.78 (SD 0.04) | 0.83 (SD 0.07) | 0.27 (SD 0.05) | ✓ | 0.80 SD (0.04) | 0.85 SD (0.07) | 0.24 SD (0.06) | ✓ | |
| Hispanic | 0.80 (SD 0.07) | 0.85 (SD 0.12) | 0.25 (SD 0.08) | ✓ | 0.80 SD (0.08) | 0.84 SD (0.16) | 0.25 SD (0.08) | ✓ | |
| Native | 0.78 (SD 0.17) | 0.97 (SD 0.07) | 0.43 (SD 0.35) | ✗ | 0.82 SD (0.13) | 1.00 SD (0.00) | 0.35 SD (0.23) | ✓ | |
| Other | 0.76 (SD 0.06) | 0.72 (SD 0.10) | 0.19 (SD 0.05) | ✓ | 0.79 SD (0.07) | 0.77 SD (0.09) | 0.20 SD (0.09) | ✓ | |
| Unknown | 0.79 (SD 0.05) | 0.83 (SD 0.11) | 0.25 (SD 0.03) | ✓ | 0.82 SD (0.03) | 0.87 SD (0.06) | 0.23 SD (0.05) | ✓ | |
| White | 0.77 (SD 0.02) | 0.79 (SD 0.06) | 0.24 (SD 0.03) | ✓ | 0.80 SD (0.02) | 0.84 SD (0.04) | 0.24 SD (0.05) | ✓ | |
| Insurance | Medicaid | 0.72 (SD 0.07) | 0.69 (SD 0.17) | 0.26 (SD 0.06) | ✗ | 0.76 SD (0.08) | 0.77 SD (0.16) | 0.26 SD (0.05) | ✓ |
| Medicare | 0.78 (SD 0.03) | 0.81 (SD 0.06) | 0.25 (SD 0.02) | ✓ | 0.81 SD (0.02) | 0.85 SD (0.04) | 0.24 SD (0.05) | ✓ | |
| Other | 0.78 (SD 0.02) | 0.80 (SD 0.05) | 0.24 (SD 0.03) | ✓ | 0.80 SD (0.02) | 0.84 SD (0.05) | 0.23 SD (0.04) | ✓ | |
| Language | English | 0.77 (SD 0.04) | 0.79 (SD 0.09) | 0.25 (SD 0.04) | ✓ | 0.81 SD (0.06) | 0.85 SD (0.11) | 0.24 SD (0.05) | ✓ |
| Other | 0.78 (SD 0.02) | 0.80 (SD 0.05) | 0.25 (SD 0.02) | ✓ | 0.77 SD (0.01) | 0.78 SD (0.04) | 0.24 SD (0.04) | ✓ | |
| Marital status | Divorced | 0.78 (SD 0.04) | 0.80 (SD 0.10) | 0.24 (SD 0.03) | ✓ | 0.79 SD (0.05) | 0.82 SD (0.09) | 0.24 SD (0.05) | ✓ |
| Married | 0.77 (SD 0.03) | 0.77 (SD 0.06) | 0.22 (SD 0.02) | ✓ | 0.81 SD (0.01) | 0.83 SD (0.05) | 0.22 SD (0.05) | ✓ | |
| Single | 0.78 (SD 0.02) | 0.84 (SD 0.05) | 0.28 (SD 0.03) | ✓ | 0.79 SD (0.03) | 0.84 SD (0.06) | 0.27 SD (0.04) | ✓ | |
| Widowed | 0.79 (SD 0.04) | 0.82 (SD 0.08) | 0.24 (SD 0.02) | ✓ | 0.81 SD (0.03) | 0.85 SD (0.07) | 0.24 SD (0.06) | ✓ | |
| Unknown | 0.77 (SD 0.05) | 0.83 (SD 0.09) | 0.29 (SD 0.05) | ✓ | 0.84 SD (0.04) | 0.93 SD (0.06) | 0.24 SD (0.07) | ✓ | |
SD Standard deviation, AUROC Area under the receiver operating characteristic, TPR True positive rate, FPR False positive rate, EO Equalised odds