Table 2.
a. Performance of cancers screening algorithms. b. Performance of screening top three types cancers.
| a. | ||||
|---|---|---|---|---|
| Male | LR | RF | SVM | |
| AUROC | ||||
| Internal CV | 0.7654 (0.7596, 0.7713) | 0.7555 (0.7499, 0.7612) | 0.7440 (0.7380, 0.7500) | |
| External validation | 0.8736 (0.8347, 0.9125) | 0.8382 (0.7984, 0.8781) | 0.6804 (0.5880, 0.7728) | |
| MCC | ||||
| Internal CV | 0.0554 (0.0522, 0.0566) | 0.0551 (0.0529, 0.0573) | 0.0504 (0.0483, 0.0525) | |
| External validation | 0.2092 (0.1969, 0.2214) | 0.1384 (0.1280, 0.1489) | 0.1217 (0.1119, 0.1316) | |
| Weighted Accuracy | ||||
| Internal CV | 0.7076 (0.7032, 0.7120) | 0.7311 (0.7268, 0.7354) | 0.7201 (0.7157, 0.7244) | |
| External validation | 0.8171 (0.8055, 0.8288) | 0.7686 (0.7558, 0.7813) | 0.7098 (0.6961, 0.7235) | |
| Sensitivity | ||||
| Internal CV | 0.6604 (0.6597, 0.6611) | 0.6757 (0.6749, 0.6764) | 0.7028 (0.7021, 0.7035) | |
| External validation | 0.7742 (0.7616, 0.7868) | 0.8387 (0.8276, 0.8498) | 0.6129 (0.5982, 0.6276) | |
| Specificity | ||||
| Internal CV | 0.7418 (0.7412, 0.7425) | 0.7203 (0.7197, 0.7210) | 0.6996 (0.6989, 0.7003) | |
| External validation | 0.8601 (0.8496, 0.8706) | 0.6984 (0.6846, 0.7123) | 0.8068 (0.7948, 0.8187) | |
| Female | LR | RF | SVM | |
| AUROC | ||||
| Internal CV | 0.6068 (0.5995, 0.6140) | 0.6665 (0.6596, 0.6733) | 0.5794 (0.5717, 0.5870) | |
| External validation | 0.6181 (0.5428, 0.6935) | 0.6938 (0.6298, 0.7579) | 0.5551 (0.4834, 0.6268) | |
| MCC | ||||
| Internal CV | 0.0218 (0.0205, 0.0231) | 0.0353 (0.0337, 0.0370) | 0.0272 (0.0258, 0.0287) | |
| External validation | 0.0312 (0.0296, 0.0327) | 0.0562 (0.0542, 0.0582) | −0.0042 (−0.0048, −0.0036) | |
| Weighted Accuracy | ||||
| Internal CV | 0.5818 (0.5774, 0.5861) | 0.6404 (0.6361, 0.6446) | 0.6052 (0.6009, 0.6095) | |
| External validation | 0.5673 (0.5360, 0.5717) | 0.6349 (0.6307, 0.6392) | 0.4904 (0.4860, 0.4948) | |
| Sensitivity | ||||
| Internal CV | 0.4850 (0.4843, 0.4857) | 0.5736 (0.5729, 0.5743) | 0.3298 (0.3292, 0.3305) | |
| External validation | 0.5192 (0.5055, 0.5329) | 0.6923 (0.6796, 0.7050) | 0.2885 (0.2760, 0.3009) | |
| Specificity | ||||
| Internal CV | 0.6657 (0.6651, 0.6664) | 0.6521 (0.6515, 0.6528) | 0.8007 (0.8002, 0.8013) | |
| External validation | 0.6855 (0.6728, 0.6983) | 0.6139 (0.6005, 0.6272) | 0.6553 (0.6422, 0.6683) | |
| b. | ||||
| Male | Colon Cancer | Liver Cancer | Prostate Cancer | Other |
| AUROC | 0.8290 (0.6660, 0.9921) | 0.8694 (0.7977, 0.9411) | 0.8608 (0.7961, 0.9255) | 0.9319 (0.9003, 0.9636) |
| Accuracy | 0.8106 (0.7987, 0.8224) | 0.8662 (0.8559, 0.8765) | 0.8448 (0.8338, 0.8557) | 0.8602 (0.8498, 0.8707) |
| Sensitivity | 0.8333 (0.8221, 0.8446) | 0.8000 (0.7879, 0.8121) | 1 | 0.7241 (0.7106, 0.7376) |
| Specificity | 0.8080 (0.7961, 0.8199) | 0.8649 (0.8546, 0.8752) | 0.8425 (0.8315, 0.8535) | 0.8601 (0.8496, 0.8706) |
| Female | Breast Cancer | Cervical Cancer | Thyroid Cancer | Other |
| AUROC | 0.6776 (0.5825, 0.7727) | 0.6235 (0.1628, 1.000) | 0.6940 (0.4286, 0.9594) | 0.7259 (0.6363, 0.8155) |
| Accuracy | 0.6453 (0.6322, 0.6584) | 0.6948 (0.6821, 0.7074) | 0.7444 (0.7324, 0.7563) | 0.5821 (0.5686, 0.5957) |
| Sensitivity | 0.5926 (0.5791, 0.6061) | 0.5000 (0.4863, 0.5137) | 0.6000 (0.5866, 0.6134) | 0.7778 (0.7664, 0.7862) |
| Specificity | 0.6456 (0.6324, 0.6587) | 0.6948 (0.6822, 0.7075) | 0.7445 (0.7325, 0.7565) | 0.5814 (0.5679, 0.5950) |
LR: logistic regression; RF: random forest; SVM: support vector machine; AUROC: area under the receiver operating characteristic curve; CV: cross-validation; MCC: Matthews correlation coefficient. The metrics are described with mean and 95% confidence interval. AUROC: area under the receiver operating characteristic curve; Other: other cancer types. The metrics are described with mean and 95% confidence interval.