Table 5.
Performance comparison of the baseline CP, existing CPs, and our proposed CP (i.e., COMPAC) across demographic subgroups in the chart-reviewed cohort, using all encounters before age 18 for patient identification.
| Rule | Sensitivity (95%CI) | PPV (95%CI) |
F1-Score (95%CI) |
|---|---|---|---|
| Sex: Female (N = 207) | |||
| dx ≥ 1 | 0.721 (0.583, 0.864) | 0.814 (0.632, 0.95) | 0.762 (0.632, 0.884) |
| *dx ≥ 2 | 0.676 (0.576, 0.8) | 0.978 (0.895, 1.0) | 0.798 (0.711, 0.889) |
| *CAPriCORN | 0.659 (0.536, 0.783) | 0.865 (0.7, 1.0) | 0.746 (0.622, 0.85) |
| *PheKB | 0.589 (0.454, 0.727) | 0.704 (0.5, 0.895) | 0.638 (0.488, 0.762) |
| COMPAC | 0.689 (0.577, 0.818) | 0.886 (0.737, 1.0) | 0.773 (0.667, 0.87) |
| Sex: Male (N = 213) | |||
| dx ≥ 1 | 0.735 (0.613, 0.864) | 0.883 (0.737, 1.0) | 0.8 (0.694, 0.9) |
| *dx ≥ 2 | 0.648 (0.562, 0.76) | 0.961 (0.85, 1.0) | 0.773 (0.692, 0.851) |
| *CAPriCORN | 0.689 (0.581, 0.8) | 0.967 (0.889, 1.0) | 0.803 (0.717, 0.889) |
| *PheKB | 0.646 (0.533, 0.769) | 0.828 (0.647, 0.95) | 0.723 (0.6, 0.829) |
| COMPAC | 0.707 (0.606, 0.833) | 0.979 (0.9, 1.0) | 0.82 (0.735, 0.905) |
| Race: NHW (N = = 209) | |||
| dx ≥ 1 | 0.71 (0.583, 0.857) | 0.835 (0.666, 1.0) | 0.765 (0.636, 0.878) |
| *dx ≥ 2 | 0.648 (0.559, 0.76) | 0.973 (0.895, 1.0) | 0.776 (0.696, 0.857) |
| *CAPriCORN | 0.664 (0.562, 0.783) | 0.926 (0.789, 1.0) | 0.772 (0.667, 0.87) |
| *PheKB | 0.6 (0.476, 0.739) | 0.758 (0.556, 0.944) | 0.668 (0.533, 0.8) |
| COMPAC | 0.696 (0.586, 0.826) | 0.96 (0.842, 1.0) | 0.805 (0.714, 0.889) |
| Race: NHB (N = 133) | |||
| dx ≥ 1 | 0.748 (0.609, 0.895) | 0.829 (0.65, 0.95) | 0.784 (0.65, 0.9) |
| *dx ≥ 2 | 0.68 (0.588, 0.8) | 0.958 (0.85, 1.0) | 0.794 (0.708, 0.889) |
| *CAPriCORN | 0.678 (0.565, 0.8) | 0.88 (0.737, 1.0) | 0.764 (0.666, 0.864) |
| *PheKB | 0.634 (0.5, 0.765) | 0.757 (0.579, 0.947) | 0.688 (0.558, 0.81) |
| COMPAC | 0.701 (0.586, 0.842) | 0.883 (0.7, 1.0) | 0.78 (0.667, 0.884) |
| Race: Hispanic (N = 38) | |||
| Sex: Female (N = 207) | |||
| dx ≥ 1 | 0.658 (0.538, 0.779) | 1 (1.0, 1.0) | 0.792 (0.7, 0.876) |
| *dx ≥ 2 | 0.489 (0.391, 0.643) | 1 (1.0, 1.0) | 0.654 (0.562, 0.783) |
| *CAPriCORN | 0.593 (0.48, 0.75) | 1 (1.0, 1.0) | 0.742 (0.649, 0.857) |
| *PheKB | 0.689 (0.56, 0.833) | 0.757 (0.55, 0.9) | 0.718 (0.571, 0.837) |
| COMPAC | 0.591 (0.48, 0.706) | 1 (1.0, 1.0) | 0.741 (0.649, 0.828) |
| Age group: 2 ~ 5 (N = 173) | |||
| dx ≥ 1 | 0.893 (0.762, 1.0) | 0.886 (0.722, 1.0) | 0.887 (0.769, 0.973) |
| *dx ≥ 2 | 0.478 (0.364, 0.617) | 1 (1.0, 1.0) | 0.644 (0.533, 0.763) |
| *CAPriCORN | 0.621 (0.5, 0.786) | 1 (1.0, 1.0) | 0.764 (0.667, 0.88) |
| *PheKB | 0.615 (0.474, 0.778) | 0.846 (0.636, 1.0) | 0.709 (0.556, 0.848) |
| COMPAC | 0.618 (0.5, 0.786) | 1 (1.0, 1.0) | 0.761 (0.667, 0.88) |
| Age group: 6 ~ 12 (N = 132) | |||
| dx ≥ 1 | 0.711 (0.571, 0.85) | 0.809 (0.632, 0.95) | 0.754 (0.615, 0.865) |
| *dx ≥ 2 | 0.64 (0.556, 0.741) | 0.95 (0.85, 1.0) | 0.764 (0.681, 0.851) |
| *CAPriCORN | 0.665 (0.552, 0.792) | 0.888 (0.737, 1.0) | 0.759 (0.651, 0.864) |
| *PheKB | 0.569 (0.444, 0.714) | 0.713 (0.5, 0.895) | 0.63 (0.476, 0.762) |
| COMPAC | 0.7 (0.586, 0.818) | 0.913 (0.75, 1.0) | 0.79 (0.694, 0.884) |
| Age group: 13 ~ 18 (N = 90) | |||
| dx ≥ 1 | 0.761 (0.643, 0.9) | 0.947 (0.842, 1.0) | 0.842 (0.739, 0.927) |
| *dx ≥ 2 | 0.648 (0.559, 0.76) | 0.977 (0.895, 1.0) | 0.778 (0.704, 0.864) |
| *CAPriCORN | 0.669 (0.567, 0.783) | 0.945 (0.842, 1.0) | 0.782 (0.694, 0.87) |
| *PheKB | 0.612 (0.5, 0.741) | 0.834 (0.65, 1.0) | 0.704 (0.578, 0.818) |
| COMPAC | 0.686 (0.586, 0.8) | 0.949 (0.842, 1.0) | 0.795 (0.708, 0.884) |
Note: *Each visit can count only 1 diagnosis (dx) or 1 medication (ICS or BDR) or 1 keyword (kw).