Table 2.
Predictive performance of models based on CTV, GTV, and GTVtb for radiotherapy treatment response assessment
| Models | Training cohort | Validation cohort | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| AUC (95%CI) | Accuracy | Precision | SENS | SPEC | AUC (95%CI) | Accuracy | Precision | SENS | SPEC | |
| GTV_Combined SVM model | 0.797 (0.400, 1.000) | 0.797 | 0.797 | 0.797 | 0.797 | 0.635 (0.451, 0.761) | 0.599 | 0.643 | 0.493 | 0.691 |
| GTV_Radiomic SVM model | 0.546 (0.286, 0.801) | 0.554 | 0.487 | 0.444 | 0.657 | 0.524 (0.410, 0.638) | 0.571 | 0.613 | 0.494 | 0.637 |
| GTV_Clinical SVM model | 0.776 (0.410, 0.964) | 0.733 | 0.630 | 0.686 | 0.744 | 0.558 (0.502, 0.621) | 0.529 | 0.407 | 0.474 | 0.576 |
| GTV_DVH SVM model | 0.799 (0.782, 0.819) | 0.698 | 0.752 | 0.698 | 0.690 | 0.629 (0.609, 0.664) | 0.543 | 0.532 | 0.430 | 0.640 |
| GTV_Dosiomic SVM model | 0.748 (0.440, 0.924) | 0.610 | 0.508 | 0.543 | 0.673 | 0.582 (0.526, 0.665) | 0.507 | 0.381 | 0.370 | 0.627 |
| GTVtb_Combined SVM model | 0.798 (0.402, 1.000) | 0.806 | 0.684 | 0.797 | 0.779 | 0.619 (0.326, 0.882) | 0.608 | 0.324 | 0.565 | 0.619 |
| GTVtb_Radiomic SVM model | 0.598 (0.311, 0.885) | 0.605 | 0.393 | 0.457 | 0.709 | 0.524 (0.420, 0.629) | 0.580 | 0.108 | 0.333 | 0.644 |
| GTVtb_Clinical SVM model | 0.757 (0.430, 0.933) | 0.716 | 0.747 | 0.767 | 0.646 | 0.625 (0.481, 0.707) | 0.546 | 0.289 | 0.700 | 0.506 |
| GTVtb_DVH SVM model | 0.569 (0.313, 0.825) | 0.588 | 0.609 | 0.711 | 0.432 | 0.522 (0.361, 0.665) | 0.537 | 0.126 | 0.435 | 0.563 |
| GTVtb_Dosiomic SVM model | 0.599 (0.320, 0.876) | 0.564 | 0.548 | 0.489 | 0.630 | 0.563 (0.499, 0.629) | 0.580 | 0.260 | 0.433 | 0.619 |
| CTV_Combined SVM model | 0.815 (0.790, 0.839) | 0.717 | 0.698 | 0.861 | 0.547 | 0.728 (0.717, 0.739) | 0.615 | 0.486 | 0.826 | 0.493 |
| CTV_Radiomic SVM model | 0.726 (0.692, 0.760) | 0.606 | 0.607 | 0.916 | 0.247 | 0.607 (0.562, 0.632) | 0.459 | 0.411 | 0.853 | 0.232 |
| CTV_Clinical SVM mode | 0.806 (0.780, 0.832) | 0.649 | 0.740 | 0.548 | 0.712 | 0.565 (0.497, 0.632) | 0.521 | 0.285 | 0.389 | 0.597 |
| CTV_DVH SVM model | 0.722 (0.441, 0.882) | 0.691 | 0.696 | 0.887 | 0.458 | 0.631 (0.524, 0.717) | 0.542 | 0.476 | 0.640 | 0.485 |
| CTV_Dosiomic SVM model | 0.554 (0.348, 0.743) | 0.534 | 0.533 | 0.820 | 0.192 | 0.551 (0.466, 0.610) | 0.371 | 0.340 | 0.786 | 0.131 |
| GTV_Combined RF model | 0.617 (0.545, 0.691) | 0.562 | 0.560 | 0.749 | 0.376 | 0.555 (0.505, 0.617) | 0.514 | 0.481 | 0.677 | 0.373 |
| GTV_Radiomic RF model | 0.514 (0.428, 0.599) | 0.504 | 0.510 | 0.484 | 0.522 | 0.504 (0.453, 0.576) | 0.493 | 0.445 | 0.399 | 0.573 |
| GTV_Clinical RF model | 0.627 (0.570, 0.687) | 0.556 | 0.581 | 0.734 | 0.364 | 0.587 (0.505, 0.695) | 0.564 | 0.520 | 0.598 | 0.534 |
| GTV_DVH RF model | 0.577 (0.518, 0.623) | 0.563 | 0.558 | 0.433 | 0.684 | 0.566 (0.487, 0.654) | 0.558 | 0.524 | 0.370 | 0.720 |
| GTV_Dosiomic RF model | 0.621 (0.566, 0.677) | 0.555 | 0.550 | 0.674 | 0.431 | 0.577 (0.491, 0.677) | 0.571 | 0.565 | 0.554 | 0.586 |
| GTVtb_Combined RF model | 0.791 (0.734, 0.852) | 0.678 | 0.661 | 0.798 | 0.573 | 0.552 (0.481, 0.633) | 0.586 | 0.247 | 0.433 | 0.626 |
| GTVtb_Radiomic RF model | 0.802 (0.712, 0.888) | 0.722 | 0.680 | 0.894 | 0.557 | 0.517 (0.414, 0.620) | 0.476 | 0.200 | 0.533 | 0.461 |
| GTVtb_Clinical RF model | 0.665 (0.576, 0.756) | 0.582 | 0.519 | 0.896 | 0.310 | 0.567 (0.514, 0.622) | 0.463 | 0.224 | 0.632 | 0.419 |
| GTVtb_DVH RF model | 0.708 (0.654, 0.758) | 0.678 | 0.665 | 0.734 | 0.614 | 0.520 (0.470, 0.577) | 0.455 | 0.205 | 0.533 | 0.435 |
| GTVtb_Dosiomic RF model | 0.875 (0.809, 0.944) | 0.782 | 0.732 | 0.913 | 0.646 | 0.615 (0.557, 0.689) | 0.504 | 0.244 | 0.634 | 0.471 |
| CTV_Combined RF model | 0.617 (0.582, 0.645) | 0.559 | 0.511 | 0.758 | 0.411 | 0.550 (0.454, 0.626) | 0.537 | 0.419 | 0.679 | 0.454 |
| CTV_Radiomic RF model | 0.588 (0.545, 0.632) | 0.567 | 0.519 | 0.710 | 0.461 | 0.555 (0.525, 0.585) | 0.498 | 0.393 | 0.679 | 0.393 |
| CTV_Clinical RF mode | 0.572 (0.541, 0.595) | 0.521 | 0.546 | 0.662 | 0.379 | 0.556 (0.476, 0.636) | 0.503 | 0.382 | 0.614 | 0.439 |
| CTV_DVH RF model | 0.565 (0.538, 0.593) | 0.500 | 0.460 | 0.765 | 0.288 | 0.554 (0.457, 0.657) | 0.462 | 0.391 | 0.773 | 0.283 |
| CTV_Dosiomic RF model | 0.601 (0.558, 0.660) | 0.533 | 0.484 | 0.699 | 0.405 | 0.553 (0.509, 0.608) | 0.556 | 0.423 | 0.574 | 0.546 |
| GTV_Combined XGBoost model | 0.641 (0.588, 0.697) | 0.607 | 0.623 | 0.583 | 0.624 | 0.675 (0.581, 0.747) | 0.614 | 0.593 | 0.539 | 0.680 |
| GTV_Radiomic XGBoost model | 0.530 (0.427, 0.608) | 0.541 | 0.504 | 0.522 | 0.569 | 0.548 (0.495, 0.609) | 0.579 | 0.546 | 0.491 | 0.654 |
| GTV_Clinical XGBoost model | 0.615 (0.571, 0.661) | 0.444 | 0.192 | 0.398 | 0.602 | 0.588 (0.549, 0.623) | 0.507 | 0.185 | 0.398 | 0.602 |
| GTV_DVH XGBoost model | 0.541 (0.441, 0.652) | 0.534 | 0.541 | 0.485 | 0.579 | 0.588 (0.541, 0.636) | 0.586 | 0.577 | 0.477 | 0.680 |
| GTV_Dosiomic XGBoost model | 0.604 (0.535, 0.669) | 0.578 | 0.703 | 0.461 | 0.709 | 0.683 (0.537, 0.768) | 0.571 | 0.609 | 0.464 | 0.665 |
| GTVtb_Combined XGBoost model | 0.768 (0.677, 0.851) | 0.652 | 0.661 | 0.722 | 0.610 | 0.516 (0.428, 0.604) | 0.538 | 0.242 | 0.567 | 0.530 |
| GTVtb_Radiomic XGBoost model | 0.813 (0.693, 0.929) | 0.791 | 0.821 | 0.780 | 0.811 | 0.581 (0.546, 0.620) | 0.434 | 0.221 | 0.700 | 0.365 |
| GTVtb_Clinical XGBoost model | 0.592 (0.504, 0.663) | 0.426 | 0.340 | 0.802 | 0.198 | 0.551 (0.497, 0.609) | 0.323 | 0.166 | 0.802 | 0.198 |
| GTVtb_DVH XGBoost model | 0.740 (0.656, 0.838) | 0.678 | 0.664 | 0.761 | 0.608 | 0.621 (0.564, 0.673) | 0.593 | 0.290 | 0.600 | 0.591 |
| GTVtb_Dosiomic XGBoost model | 0.880 (0.841, 0.916) | 0.748 | 0.787 | 0.719 | 0.796 | 0.593 (0.530, 0.682) | 0.635 | 0.304 | 0.467 | 0.679 |
| CTV_Combined XGBoost model | 0.657 (0.628, 0.690) | 0.563 | 0.514 | 0.731 | 0.437 | 0.666 (0.627, 0.706) | 0.556 | 0.420 | 0.586 | 0.539 |
| CTV_Radiomic XGBoost model | 0.629 (0.594, 0.665) | 0.559 | 0.509 | 0.667 | 0.485 | 0.585 (0.538, 0.635) | 0.498 | 0.388 | 0.652 | 0.409 |
| CTV_Clinical XGBoost mode | 0.656 (0.594, 0.719) | 0.454 | 0.092 | 0.202 | 0.798 | 0.569 (0.536, 0.620) | 0.580 | 0.074 | 0.202 | 0.798 |
| CTV_DVH XGBoost model | 0.654 (0.612, 0.698) | 0.608 | 0.555 | 0.560 | 0.653 | 0.585 (0.528, 0.630) | 0.576 | 0.423 | 0.399 | 0.678 |
| CTV_Dosiomic XGBoost model | 0.641 (0.604, 0.679) | 0.563 | 0.534 | 0.784 | 0.413 | 0.551 (0.485, 0.622) | 0.484 | 0.386 | 0.665 | 0.379 |
| GTV_Combined LR model | 0.832 (0.789, 0.863) | 0.774 | 0.739 | 0.865 | 0.680 | 0.608 (0.575, 0.638) | 0.557 | 0.528 | 0.555 | 0.559 |
| GTV_Radiomic LR model | 0.588 (0.557, 0.627) | 0.610 | 0.604 | 0.660 | 0.559 | 0.535 (0.495, 0.571) | 0.493 | 0.460 | 0.632 | 0.373 |
| GTV_Clinical LR model | 0.763 (0.729, 0.793) | 0.610 | 0.364 | 0.443 | 0.711 | 0.556 (0.540, 0.573) | 0.550 | 0.308 | 0.428 | 0.656 |
| GTV_DVH LR model | 0.615 (0.558, 0.672) | 0.569 | 0.674 | 0.591 | 0.529 | 0.511 (0.471, 0.560) | 0.492 | 0.526 | 0.463 | 0.517 |
| GTV_Dosiomic LR model | 0.637 (0.609, 0.677) | 0.590 | 0.772 | 0.529 | 0.630 | 0.542 (0.513, 0.582) | 0.500 | 0.509 | 0.417 | 0.571 |
| GTVtb_Combined LR model | 0.988 (0.984, 0.994) | 0.945 | 0.920 | 0.973 | 0.915 | 0.698 (0.546, 0.793) | 0.710 | 0.418 | 0.566 | 0.748 |
| GTVtb_Radiomic LR model | 0.866 (0.829, 0.907) | 0.806 | 0.806 | 0.786 | 0.820 | 0.523 (0.472, 0.570) | 0.462 | 0.220 | 0.633 | 0.417 |
| GTVtb_Clinical LR model | 0.832 (0.795, 0.860) | 0.624 | 0.644 | 0.822 | 0.343 | 0.639 (0.607, 0.684) | 0.364 | 0.214 | 0.701 | 0.276 |
| GTVtb_DVH LR model | 0.855 (0.806, 0.904) | 0.782 | 0.827 | 0.703 | 0.853 | 0.666 (0.568, 0.732) | 0.469 | 0.265 | 0.833 | 0.374 |
| GTVtb_Dosiomic LR model | 0.814 (0.780, 0.851) | 0.679 | 0.848 | 0.571 | 0.740 | 0.558 (0.491, 0.632) | 0.461 | 0.180 | 0.568 | 0.434 |
| CTV_Combined LR model | 0.815 (0.789, 0.839) | 0.700 | 0.678 | 0.876 | 0.487 | 0.713 (0.683, 0.743) | 0.571 | 0.450 | 0.772 | 0.455 |
| CTV_Radiomic LR model | 0.713 (0.671, 0.755) | 0.600 | 0.579 | 0.967 | 0.163 | 0.616 (0.604, 0.627) | 0.371 | 0.353 | 0.853 | 0.093 |
| CTV_Clinical LR mode | 0.709 (0.688, 0.737) | 0.623 | 0.688 | 0.494 | 0.717 | 0.565 (0.523, 0.617) | 0.541 | 0.297 | 0.388 | 0.630 |
| CTV_DVH LR model | 0.635 (0.611, 0.658) | 0.560 | 0.572 | 0.687 | 0.399 | 0.558 (0.512, 0.610) | 0.528 | 0.406 | 0.518 | 0.533 |
| CTV_Dosiomic LR model | 0.653 (0.628, 0.674) | 0.580 | 0.566 | 0.961 | 0.127 | 0.631 (0.592, 0.655) | 0.400 | 0.367 | 0.879 | 0.124 |