Table 3.
Performance of LPAIDS in different validation datasets
| FAHSYSU validation | External validation | |||||
|---|---|---|---|---|---|---|
| Internal validation | SYMSYSU | NHSMU | FAHSU | TAHSYSU | SAHSYSU | |
| Accuracy (95% CI) | 0·956 (0·951–0·960) | 0·949 (0·944–0·954) | 0·951 (0·946–0·956) | 0·984 (0·981–0·988) | 0·980 (0·975–0·985) | 0·976 (0·970–0·982) |
| Sensitivity (95% CI) | 0·948 (0·941–0·955) | 0·961 (0·950–0·971) | 0·920 (0·893–0·948) | 0·927 (0·896–0·959) | 0·986 (0·972–1·000) | 0·901 (0·868–0·933) |
| Specificity (95% CI) | 0·964 (0·958–0·970) | 0·946 (0·941–0·952) | 0·953 (0·948–0·958) | 0·987 (0·984–0·990) | 0·979 (0·974–0·984) | 0·986 (0·982–0·991) |
| PPV (95% CI) | 0·965 (0·959–0·971) | 0·793 (0·773–0·813) | 0·538 (0·500–0·577) | 0·796 (0·751–0·841) | 0·821 (0·780–0·862) | 0·898 (0·865–0·930) |
| NPV (95% CI) | 0·946 (0·939–0·953) | 0·991 (0·989–0·994) | 0·995 (0·993–0·997) | 0·996 (0·994–0·998) | 0·999 (0·997–1·000) | 0·987 (0·982–0·991) |
| AUC | 0·974 | 0·980 | 0·965 | 0·971 | 0·987 | 0·974 |
AUC, area under the curve; CI: confidence interval; FAHSU: First Affiliated Hospital of Shenzhen University; FAHSYSU: First Affiliated Hospital of Sun Yat-sen University; LPAIDS: Laryngopharyngeal Artificial Intelligence Diagnostic System; NHSMU: Nanfang Hospital of Southern Medical University; NPV, negative predictive value; PPV, positive predictive value; SAHSYSU: Sixth Affiliated Hospital of Sun Yat-sen University; SYMSYSU: Sun Yat-sen Memorial Hospital of Sun Yat-sen University; TAHSYSU: Third Affiliated Hospital of Sun Yat-sen University