Table 3.
Validation of time-window prediction models for traumatic hemorrhagic shock
Internal validation | External validation | ||||||||||||
Machine learning model | Prediction dataset | F 1.5 | acc | pre | rec | AUROC | AUPRC | F 1.5 | acc | pre | rec | AUROC | AUPRC |
0.5 h in advance | |||||||||||||
XGBoost | VS | 0.849 | 0.865 | 0.866 | 0.847 | 0.935 | 0.943 | 0.704 | 0.665 | 0.571 | 0.804 | 0.785 | 0.720 |
LR | VS | 0.794 | 0.835 | 0.853 | 0.778 | 0.875 | 0.887 | 0.701 | 0.661 | 0.558 | 0.801 | 0.797 | 0.773 |
1 h in advance | |||||||||||||
XGBoost | VS | 0.793 | 0.833 | 0.853 | 0.773 | 0.927 | 0.920 | 0.695 | 0.649 | 0.551 | 0.804 | 0.769 | 0.697 |
VS + RB | 0.866 | 0.883 | 0.889 | 0.860 | 0.950 | 0.943 | 0.834 | 0.841 | 0.851 | 0.827 | 0.913 | 0.915 | |
VS + RB + BG | 0.900 | 0.903 | 0.898 | 0.903 | 0.968 | 0.962 | 0.804 | 0.822 | 0.847 | 0.787 | 0.901 | 0.908 | |
LR | VS | 0.775 | 0.819 | 0.836 | 0.755 | 0.878 | 0.897 | 0.703 | 0.652 | 0.549 | 0.815 | 0.792 | 0.761 |
VS + RB | 0.863 | 0.875 | 0.867 | 0.863 | 0.889 | 0.883 | 0.834 | 0.846 | 0.863 | 0.822 | 0.916 | 0.928 | |
VS + RB + BG | 0.872 | 0.875 | 0.872 | 0.875 | 0.930 | 0.932 | 0.841 | 0.856 | 0.882 | 0.824 | 0.916 | 0.929 | |
2 h in advance | |||||||||||||
XGBoost | VS | 0.781 | 0.859 | 0.873 | 0.760 | 0.937 | 0.905 | 0.679 | 0.653 | 0.558 | 0.777 | 0.772 | 0.699 |
VS + RB | 0.863 | 0.873 | 0.886 | 0.858 | 0.947 | 0.950 | 0.807 | 0.836 | 0.881 | 0.778 | 0.924 | 0.911 | |
VS + RB + BG | 0.869 | 0.870 | 0.856 | 0.880 | 0.934 | 0.914 | 0.798 | 0.830 | 0.876 | 0.770 | 0.922 | 0.914 | |
LR | VS | 0.730 | 0.806 | 0.779 | 0.730 | 0.866 | 0.849 | 0.687 | 0.659 | 0.555 | 0.780 | 0.783 | 0.747 |
VS + RB | 0.835 | 0.847 | 0.875 | 0.828 | 0.905 | 0.898 | 0.835 | 0.846 | 0.862 | 0.823 | 0.909 | 0.924 | |
VS + RB + BG | 0.860 | 0.847 | 0.813 | 0.887 | 0.912 | 0.891 | 0.832 | 0.847 | 0.870 | 0.817 | 0.913 | 0.926 | |
3 h in advance | |||||||||||||
XGBoost | VS + RB | 0.857 | 0.888 | 0.935 | 0.828 | 0.946 | 0.959 | 0.703 | 0.766 | 0.842 | 0.658 | 0.842 | 0.840 |
VS + RB + BG | 0.863 | 0.873 | 0.886 | 0.858 | 0.957 | 0.950 | 0.807 | 0.836 | 0.881 | 0.778 | 0.924 | 0.911 | |
LR | VS + RB | 0.838 | 0.864 | 0.905 | 0.815 | 0.919 | 0.943 | 0.775 | 0.793 | 0.815 | 0.758 | 0.856 | 0.876 |
VS + RB + BG | 0.835 | 0.847 | 0.875 | 0.828 | 0.905 | 0.898 | 0.835 | 0.846 | 0.862 | 0.823 | 0.909 | 0.924 |
VS represents vital signs; VS + RB represents vital signs + routine blood; VS + RB + BG represents vital signs + routine blood + blood gas analysis. AUPRC, area under the precision-recall curve; AUROC, area under the receiver operating characteristic curve; BG, blood gas; RB, routine blood; VS, vital signs.