Skip to main content
. 2021 Aug 10;57(1):48–56. doi: 10.1097/SHK.0000000000001842

Table 3.

Validation of time-window prediction models for traumatic hemorrhagic shock

Internal validation External validation
Machine learning model Prediction dataset F 1.5 acc pre rec AUROC AUPRC F 1.5 acc pre rec AUROC AUPRC
0.5 h in advance
 XGBoost VS 0.849 0.865 0.866 0.847 0.935 0.943 0.704 0.665 0.571 0.804 0.785 0.720
 LR VS 0.794 0.835 0.853 0.778 0.875 0.887 0.701 0.661 0.558 0.801 0.797 0.773
1 h in advance
 XGBoost VS 0.793 0.833 0.853 0.773 0.927 0.920 0.695 0.649 0.551 0.804 0.769 0.697
VS + RB 0.866 0.883 0.889 0.860 0.950 0.943 0.834 0.841 0.851 0.827 0.913 0.915
VS + RB + BG 0.900 0.903 0.898 0.903 0.968 0.962 0.804 0.822 0.847 0.787 0.901 0.908
 LR VS 0.775 0.819 0.836 0.755 0.878 0.897 0.703 0.652 0.549 0.815 0.792 0.761
VS + RB 0.863 0.875 0.867 0.863 0.889 0.883 0.834 0.846 0.863 0.822 0.916 0.928
VS + RB + BG 0.872 0.875 0.872 0.875 0.930 0.932 0.841 0.856 0.882 0.824 0.916 0.929
2 h in advance
 XGBoost VS 0.781 0.859 0.873 0.760 0.937 0.905 0.679 0.653 0.558 0.777 0.772 0.699
VS + RB 0.863 0.873 0.886 0.858 0.947 0.950 0.807 0.836 0.881 0.778 0.924 0.911
VS + RB + BG 0.869 0.870 0.856 0.880 0.934 0.914 0.798 0.830 0.876 0.770 0.922 0.914
 LR VS 0.730 0.806 0.779 0.730 0.866 0.849 0.687 0.659 0.555 0.780 0.783 0.747
VS + RB 0.835 0.847 0.875 0.828 0.905 0.898 0.835 0.846 0.862 0.823 0.909 0.924
VS + RB + BG 0.860 0.847 0.813 0.887 0.912 0.891 0.832 0.847 0.870 0.817 0.913 0.926
3 h in advance
 XGBoost VS + RB 0.857 0.888 0.935 0.828 0.946 0.959 0.703 0.766 0.842 0.658 0.842 0.840
VS + RB + BG 0.863 0.873 0.886 0.858 0.957 0.950 0.807 0.836 0.881 0.778 0.924 0.911
 LR VS + RB 0.838 0.864 0.905 0.815 0.919 0.943 0.775 0.793 0.815 0.758 0.856 0.876
VS + RB + BG 0.835 0.847 0.875 0.828 0.905 0.898 0.835 0.846 0.862 0.823 0.909 0.924

VS represents vital signs; VS + RB represents vital signs + routine blood; VS + RB + BG represents vital signs + routine blood + blood gas analysis. AUPRC, area under the precision-recall curve; AUROC, area under the receiver operating characteristic curve; BG, blood gas; RB, routine blood; VS, vital signs.