Table 1.
Validation of the laparoscopic Roux-en-Y gastric bypass ontology: Inter-rater reliability results
| Cohen’s kappa | Accuracy | Precision | Recall | F1-score | ATD (seconds) | CTM | NL | AD-accuracy | AD-precision | AD-recall | AD-F1-score | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Bypass40 | Phases | 96.8 ± 2.7 | 97.4 ± 2.1 | 92.9 ± 6.6 | 92.9 ± 6.6 | 92.6 ± 6.9 | 8.2 ± 4.8 | 100.1 ± 0.2 | 1.5 ± 2.3 | 97.8 ± 2.2 | 93.8 ± 6.8 | 93.8 ± 6.8 | 93.5 ± 7.1 |
| Steps | 85.4 ± 6.0 | 86.6 ± 6.0 | 74.2 ± .10.4 | 74.2 ± 10.4 | 72.0 ± 10.0 | 13.4 ± 9.0 | 100.9 ± 1.0 | 9.2 ± 6.4 | 87.9 ± 6.2 | 77.1 ± 10.8 | 77.3 ± 11.1 | 75.2 ± 10.7 | |
| Bypass70 | Phases | 94.9 ± 5.8 | 96.0 ± 4.6 | 86.6 ± 12.0 | 86.6 ± 12.0 | 85.8 ± 12.0 | 10.0 ± 3.3 | 100.8 ± 1.9 | 2.5 ± 4.9 | 96.5 ± 4.7 | 89.0 ± 10.8 | 88.4 ± 12.4 | 87.8 ± 12.3 |
| Steps | 76.1 ± 13.9 | 78.4 ± 12.6 | 58.8 ± 20.5 | 58.8 ± 20.5 | 57.2 ± 19.7 | 10.7 ± 6.2 | 101.4 ± 0.6 | 18.0 ± 14.3 | 79.6 ± .13.2 | 61.3 ± 21.4 | 61.4 ± 21.7 | 59.8 ± 20.9 | |
| Overall | Phases | 95.9 ± 4.3 | 96.7 ± 3.7 | 89.7 ± 10.1 | 89.7 ± 10.1 | 89.2 ± 10.4 | 9.1 ± 4.2 | 99.1 ± 5.7 | 2.0 ± 3.9 | 97.1 ± 3.7 | 91.5 ± 9.4 | 91.0 ± 10.2 | 90.7 ± 10.5 |
| Steps | 80.8 ± 10.0 | 82.5 ± 10.7 | 66.5 ± 18.1 | 66.5 ± 18.1 | 64.6 ± 17.3 | 12.4 ± 7.6 | 100.4 ± 10.7 | 13.7 ± 11.9 | 83.7 ± 11.0 | 69.2 ± 18.9 | 69.4 ± 18.9 | 67.6 ± 18.3 |
All reported metrics are mean ± SD, in percent if not stated otherwise
ATD average transitional delay, CTM coefficient of transitional moments, NL noise level, AD application dependent