Table III. Measures of agreement for categorical variables.
| κ | 95% CI | SN | 95% CI | SP | 95% CI | PPV | 95% CI | NPV | 95% CI | % agreement | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Diminished ovarian reserve | 0.72 | (0.66, 0.78) | 0.77 | (0.69,0.83) | 0.95 | (0.94, 0.97) | 0.77 | (0.70, 0.84) | 0.95 | (0.93, 0.97) | 92.1 |
| Advanced female age | 0.60 | (0.53, 0.67) | 0.83 | (0.75, 0.89) | 0.89 | (0.86, 0.91) | 0.56 | (0.48, 0.63) | 0.97 | (0.95, 0.98) | 82.1 |
| Cycle type | 0.99 | (0.98, 1.00) | 99.4 | ||||||||
| IVF | 0.99 | (0.98, 1.00) | 1.00 | (0.99, 1.00) | 0.98 | (0.96, 0.99) | 0.99 | (0.98, 1.00) | 1.00 | (0.99, 1.00) | 99.4 |
| FET | 1.00 | (1.00, 1.00) | 1.00 | (0.99, 1.00) | 1.00 | (0.99, 1.00) | 1.00 | (0.99, 1.00) | 1.00 | (0.99, 1.00) | 100 |
| Frozen oocyte IVF | 0.87 | (0.75, 1.00) | 0.78 | (0.52, 0.94) | 1.00 | (1.00, 1.00) | 1.00 | (0.77, 1.00) | 1.00 | (0.99, 1.00) | 99.5 |
| Oocyte banking | 0.95 | (0.86, 1.00) | 0.91 | (0.59, 1.00) | 1.00 | (1.00, 1.00) | 1.00 | (0.69, 1.00) | 1.00 | (0.99, 1.00) | 99.9 |
| Cancelled cycle | 0.98 | (0.96, 1.00) | 0.97 | (0.89, 1.00) | 1.00 | (1.00, 1.00) | 1.00 | (0.94, 1.00) | 1.00 | (0.99, 1.00) | 99.8 |
| Reason cancelled | 0.47* | (0.28, 0.67) | 72.6 | ||||||||
| Low ovarian response | 0.60 | (0.40, 0.80) | 0.97 | (0.86, 1.00) | 0.58 | (0.37, 0.78) | 0.79 | (0.64, 0.89) | 0.93 | (0.68, 1.00) | 82.3 |
| Premature ovulation | 0.65 | (0.20, 1.00) | 0.67 | (0.09, 0.99) | 0.98 | (0.91, 1.00) | 0.67 | (0.09, 0.99) | 0.98 | (0.91, 1.00) | 96.8 |
| Other | 0.52 | (0.23, 0.81) | 0.60 | (0.26, 0.88) | 0.92 | (0.81, 0.98) | 0.60 | (0.26, 0.88) | 0.92 | (0.81, 0.98) | 87.1 |
| Oocyte origin | 0.45 | (0.37, 0.52) | 86.7 | ||||||||
| Fresh own oocyte | 0.56 | (0.48, 0.64) | 0.89 | (0.87, 0.91) | 0.98 | (0.92, 1.00) | 1.00 | (0.99, 1.00) | 0.44 | (0.36, 0.52) | 89.9 |
| Fresh donor oocyte | 0.89 | (0.81, 0.96) | 0.85 | (0.69, 0.94) | 1.00 | (0.99, 1.00) | 0.94 | (0.81, 0.94) | 0.99 | (0.98, 1.00) | 99.0 |
| Other | 0.15 | (−0.04, 0.33) | 0.09 | (0.01, 0.28) | 1.00 | (0.99, 1.00) | 0.67 | (0.09, 0.67) | 0.97 | (0.96, 0.99) | 97.3 |
| Embryo transfer | 1.00 | (1.00, 1.00) | 1.00 | (0.99, 1.00) | 1.00 | (0.98, 1.00) | 1.00 | (0.99, 1.00) | 1.00 | (0.98, 1.00) | 98.9 |
| # embryos transferred | 1.00 | (0.99, 1.00) | 99.9 | ||||||||
| 1 | 1.00 | (1.00, 1.00) | 1.00 | (0.99, 1.00) | 1.00 | (0.99, 1.00) | 1.00 | (0.99, 1.00) | 1.00 | (0.99, 1.00) | 100 |
| 2 | 1.00 | (0.99, 1.00) | 1.00 | (0.98, 1.00) | 1.00 | (0.99, 1.00) | 1.00 | (0.99, 1.00) | 1.00 | (0.99, 1.00) | 99.9 |
| 3 | 0.97 | (0.91, 0.97) | 1.00 | (0.79, 1.00) | 1.00 | (0.99, 1.00) | 0.94 | (0.71, 0.94) | 1.00 | (0.99, 1.00) | 99.9 |
| 4 | 1.00 | (1.00, 1.00) | 1.00 | (0.29, 1.00) | 1.00 | (0.99, 1.00) | 1.00 | (0.29, 1.00) | 1.00 | (0.99, 1.00) | 100 |
| ET day: fresh cycles | 0.99 | (0.97, 1.00) | 99.3 | ||||||||
| 2 | 0.98 | (0.94, 1.00) | 0.96 | (0.81, 1.00) | 1.00 | (0.99, 1.00) | 1.00 | (0.87, 1.00) | 1.00 | (0.99, 1.00) | 99.8 |
| 3 | 0.99 | (0.98, 1.00) | 0.99 | (0.96, 1.00) | 1.00 | (0.99, 1.00) | 1.00 | (0.98, 1.00) | 0.99 | (0.97, 1.00) | 99.5 |
| 5 | 0.99 | (0.97, 1.00) | 1.00 | (0.98, 1.00) | 0.98 | (0.96, 1.00) | 0.99 | (0.96, 1.00) | 1.00 | (0.98, 1.00) | 99.3 |
| 6 | 1.00 | (1.00, 1.00) | 1.00 | (0.03, 1.00) | 1.00 | (0.99, 1.00) | 1.00 | (0.03, 1.00) | 1.00 | (0.99, 1.00) | 100 |
| eSET or eDET | 0.55 | (0.49, 0.61) | 0.76 | (0.72, 0.80) | 0.88 | (0.82, 0.92) | 0.94 | (0.91, 0.96) | 0.58 | (0.52, 0.64) | 83.2 |
| Embryo cryopreservation—IVF | 0.91* | (0.78, 1.00) | 98.2 | ||||||||
| Vitrification | 0.86 | (0.73, 0.98) | 0.99 | (0.96, 1.00) | 0.94 | (0.71, 1.00) | 1.00 | (0.98, 1.00) | 0.80 | (0.56, 0.94) | 98.2 |
| Slow-freeze | 0.97 | (0.90, 1.00) | 1.00 | (0.79, 1.00) | 1.00 | (0.98, 1.00) | 0.94 | (0.71, 1.00) | 1.00 | (0.99, 1.00) | 99.7 |
| Mixed | 0.00 | 0.00 | 1.00 | - | - | 62.1 | |||||
| Embryo cryopreservation—FET | 0.89* | (0.77, 1.00) | 64.8 | ||||||||
| Vitrification | 0.49 | (0.38, 0.59) | 0.72 | (0.65, 0.79) | 0.96 | (0.86, 1.00) | 0.99 | (0.95, 1.00) | 0.47 | (0.37, 0.57) | 76.6 |
| Slow-freeze | 0.49 | (0.35, 0.64) | 0.39 | (0.25, 0.54) | 0.99 | (0.97, 1.00) | 0.95 | (0.75, 1.00) | 0.87 | (0.81, 0.91) | 87.3 |
| Mixed | 0.00 | 0.00 | 1.00 | - | 1.00 | 92.1 | |||||
| Pregnancy type | 0.90 | (0.88, 0.93) | 94.9 | ||||||||
| Not pregnant | 0.91 | (0.88, 0.94) | 0.97 | (0.95, 0.98) | 0.94 | (0.91, 0.97) | 0.96 | (0.94, 0.98) | 0.95 | (0.92, 0.97) | 95.8 |
| Biochemical | 0.84 | (0.76, 0.92) | 0.79 | (0.65, 0.89) | 1.00 | (0.99, 1.00) | 0.91 | (0.79, 0.98) | 0.99 | (0.98, 0.99) | 98.3 |
| Intrauterine | 0.97 | (0.95, 0.99) | 0.97 | (0.95, 0.99) | 0.99 | (0.98, 1.00) | 0.99 | (0.96, 1.00) | 0.99 | (0.97, 0.99) | 98.6 |
| Other | 1.00 | (1.00, 1.00) | 1.00 | (0.16, 1.00) | 1.00 | (1.00, 1.00) | 1.00 | (0.16, 1.00) | 1.00 | (1.00, 1.00) | 100 |
| Unknown | 0.26 | (0.07, 0.46) | 0.36 | (0.11, 0.61) | 0.98 | (0.97, 0.99) | 0.23 | (0.05, 0.40) | 0.99 | (0.98, 1.00) | 97.0 |
| # fetal sac | 0.93 | (0.88, 0.98) | 94.8 | ||||||||
| 1 | 0.87 | (0.80, 0.93) | 0.96 | (0.92, 0.98) | 0.93 | (0.83, 0.98) | 0.98 | (0.95, 0.99) | 0.87 | (0.77, 0.94) | 95.2 |
| 2 | 0.93 | (0.88, 0.98) | 0.95 | (0.87, 0.99) | 0.98 | (0.96, 1.00) | 0.94 | (0.88, 0.98) | 0.99 | (0.96, 1.00) | 97.6 |
| 3 | 0.67 | (0.05, 1.00) | 0.50 | (0.01, 0.99) | 1.00 | (0.99, 1.00) | 1.00 | (0.03, 1.00) | 1.00 | (0.99, 1.00) | 99.7 |
| # fetal heart | 0.90 | (0.85, 0.96) | 93.4 | ||||||||
| 0 | 0.85 | (0.75, 0.96) | 0.82 | (0.63, 0.94) | 0.99 | (0.97, 1.00) | 0.92 | (0.74, 0.99) | 0.98 | (0.96, 0.99) | 97.6 |
| 1 | 0.87 | (0.80, 0.93) | 0.95 | (0.91, 0.97) | 0.94 | (0.87, 0.98) | 0.98 | (0.94, 0.99) | 0.88 | (0.79, 0.94) | 94.5 |
| 2 | 0.91 | (0.85, 0.97) | 0.96 | (0.87, 1.00) | 0.97 | (0.95, 0.99) | 0.89 | (0.78, 0.96) | 0.99 | (0.97, 1.00) | 93.4 |
| 3 | 1.00 | (1.00, 1.00) | 1.00 | (0.03, 1.00) | 1.00 | (0.99, 1.00) | 1.00 | (0.03, 1.00) | 1.00 | (0.99, 1.00) | 100 |
| Chorionicity | 0.29 | (0.08, 0.51) | 73.9 | ||||||||
| 1 | 0.55 | (0.09, 1.00) | 0.50 | (0.07, 0.93) | 0.98 | (0.91, 1.00) | 0.67 | (0.09, 0.99) | 0.97 | (0.89, 1.00) | 95.4 |
| 2 | 0.34 | (0.11, 0.57) | 0.98 | (0.88, 1.00) | 0.30 | (0.12, 0.54) | 0.76 | (0.63, 0.86) | 0.86 | (0.42, 1.00) | 76.9 |
| 3 | 1.00 | (1.00, 1.00) | 1.00 | (0.03, 1.00) | 1.00 | (0.94, 1.00) | 1.00 | (0.03, 1.00) | 1.00 | (0.94, 1.00) | 100 |
κ: kappa coefficient, NPV: negative predictive value, PPV: positive predictive value, SN: sensitivity, SP: specificity
*Weighted kappa coefficient