Table 3.
The Comparison of ROC-AUC and Log Loss Results for Poorly Differentiated Adenocarcinoma (ADC) Classification on Various Test Sets between Trained Gastric Endoscopic Submucosal Dissection (ESD) Poorly Differentiated ADC deep Learning Model (ESD-Poorly ADC Model) and Existing Biopsy Model (Biopsy-Poorly ADC Model).
| ESD-Poorly ADC Model | ||
|---|---|---|
| ROC-AUC | log-loss | |
| ESD-test set-1 | 0.975 [0.962-0.986] | 0.235 [0.194-0.271] |
| ESD-test set-2 | 0.955 [0.915-0.981] | 0.658 [0.592-0.736] |
| Biopsy-test set-1 | 0.953 [0.909-0.981] | 0.352 [0.260-0.458] |
| Biopsy-test set-2 | 0.937 [0.892-0.969] | 0.205 [0.155-0.264] |
| Biopsy-test set-3 | 0.960 [0.922-0.989] | 0.156 [0.118-0.212] |
| Biopsy-SRCC-test set | 0.941 [0.896-0.975] | 0.185 [0.137-0.241] |
| Surgical-test set | 0.929 [0.909-0.949] | 0.572 [0.468-0.661] |
| Biopsy-poorly ADC model | ||
| ROC-AUC | log-loss | |
| ESD-test set-1 | 0.899 [0.869-0.927] | 0.857 [0.816-0.897] |
| ESD-test set-2 | 0.638 [0.541-0.722] | 1.104 [1.049-1.155] |
| Biopsy-test set-1 | 0.959 [0.931-0.982] | 0.587 [0.532-0.649] |
| Biopsy-test set-2 | 0.976 [0.951-0.993] | 0.199 [0.181-0.220] |
| Biopsy-test set-3 | 0.975 [0.946-0.994] | 0.418 [0.394-0.450] |
| Biopsy-SRCC-test set | 0.980 [0.953-0.995] | 0.190 [0.172-0.208] |
| Surgical-test set | 0.885 [0.857-0.910] | 0.518 [0.468-0.575] |
Abbreviations: ROC, Receiver Operator Characteristic; AUCs, the area under the curve; SRCC, signet ring cell carcinoma.