TABLE 2.
EasyCIE-SSI Performance in the Training, Internal and External Validation Cohorts
Training | Internal Validation | External Validation | p-Value* | |
---|---|---|---|---|
Sensitivity | ||||
Superficial SSI | 0.90 (0.82–0.95) | 0.92 (0.79–1.00) | 0.71 (0.66–0.75) | 0.047 |
Deep SSI | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) | 0.81 (0.72–0.88) | 0.757 |
Organ/Space SSI | 0.92 (0.88–0.96) | 0.96 (0.89–1.00) | 0.90 (0.86–0.94) | 0.334 |
SSI PATOS | 1.00 (1.00–1.00) | 0.95 (0.84–1.00) | 0.88 (0.79–0.95) | 0.665 |
Any SSI | 0.91 (0.88–0.95) | 0.94 (0.89–0.99) | 0.79 (0.75–0.82) | 0.002 |
Specificity | ||||
Superficial SSI | 0.86 (0.85–0.87) | 0.86 (0.84–0.87) | 0.90 (0.90–0.91) | 0.004 |
Deep SSI | 0.85 (0.84–0.86) | 0.85 (0.83–0.87) | 0.89 (0.89–0.90) | 0.127 |
Organ/Space SSI | 0.87 (0.86–0.88) | 0.87 (0.85–0.88) | 0.90 (0.90–0.90) | 0.443 |
SSI PATOS | 0.85 (0.84–0.86) | 0.86 (0.84–0.87) | 0.89 (0.88–0.89) | 0.156 |
Any SSI | 0.89 (0.88–0.90) | 0.88 (0.86–0.89) | 0.92 (0.92–0.92) | 0.012 |
AUC | ||||
Superficial SSI | 0.879 (0.848–00.91) | 0.887 (0.830–0.944) | 0.805 (0.782–0.827) | 0.008 |
Deep SSI | 0.924 (0.919–00.93) | 0.925 (0.917–0.933) | 0.850 (0.810–0.890) | <0.0001 |
Organ/Space SSI | 0.897 (0.876–00.92) | 0.913 (0.883–0.943) | 0.900 (0.882–0.919) | 0.484 |
SSI PATOS | 0.926 (0.921–00.93) | 0.902 (0.849–0.954) | 0.884 (0.845–0.924) | 0.608 |
Any SSI | 0.902 (0.884–00.92) | 0.912 (0.884–0.940) | 0.852 (0.837–0.868) | <0.0001 |
p-Value: comparison of EasyCIE-SSI performance on external validation cohort compared to internal validation cohort; SSI: Surgical Site Infection, PATOS: Present at the Time of Surgery, AUC: Area Under the Receiver Operating Curve