Skip to main content
. Author manuscript; available in PMC: 2022 Dec 1.
Published in final edited form as: Biometrics. 2020 Aug 29;77(4):1397–1408. doi: 10.1111/biom.13357

TABLE 2.

Simulation 1: accuracy rate of correctly identifying subgroup memberships (accuracy), mean squared error, TP, and FP rates

K Bn ρ β Index pr = (0.5, 0.5)
 pr= (0.3, 0.7)
Proposed Oracle KC True Fitted Underfitted Proposed Oracle KC True Fitted Underfitted
2 10 0 1 Accuracy 0.826 0.498 0.837 0.777 0.514 0.798 0.551 0.872 0.839 0.546
MSE 0.541 0.054 7.563 1.206 2.185 6.605 2.318 0.068 6.757 0.059 1.676 7.061
TP 1 1 0.260 0.960 1 0.408
FP 0.004 0.014 0.202 0.007 0.023 0.187
2 Accuracy 0.914 0.503 0.910 0.828 0.519 0.939 0.549 0.942 0.908 0.561
MSE 0.525 0.074 29.675 1.618 6.879 24.996 0.684 0.088 26.868 0.064 36.437 25.509
TP 1 1 0.288 1 1 0.490
FP 0.002 0.014 0.206 0.005 0.014 0.211
0.3 1 Accuracy 0.868 0.499 0.863 0.815 0.541 0.879 0.553 0.901 0.858 0.578
MSE 0.293 0.056 7.804 1.451 2.149 7.069 0.655 0.057 6.803 0.064 1.764 7.013
TP 1 1 0.205 1 1 0.390
FP 0.001 0.014 0.208 0.005 0.014 0.209
2 Accuracy 0.914 0.495 0.922 0.886 0.495 0.951 0.537 0.952 0.935 0.591
MSE 0.577 0.026 31.438 0.035 1.054 28.642 0.x326 0.106 27.596 0.071 2.191 30.680
TP 1 1 0.375 1 1 0.510
FP 0.003 0.010 0.427 0.004 0.013 0.249
0.7 1 Accuracy 0.864 0.513 0.901 0.836 0.627 0.904 0.594 0.921 0.852 0.676
MSE 0.613 0.109 7.687 0.114 10.881 9.202 0.560 0.149 7.421 0.134 12.588 10.278
TP 0.940 1 0.272 0.970 0.998 0.410
FP 0.008 0.017 0.232 0.010 0.020 0.200
2 Accuracy 0.940 0.500 0.951 0.899 0.655 0.960 0.531 0.959 0.930 0.699
MSE 0.262 0.131 30.561 0.107 12.624 30.766 0.315 0.177 32.172 0.128 40.788 43.618
TP 1 1 0.348 1 1 0.415
FP 0.027 0.016 0.349 0.009 0.017 0.312
5 0 1 Accuracy 0.781 0.500 0.853 0.577 0.503 0.781 0.558 0.880 0.671 0.526
MSE 0.785 0.047 7.483 0.048 5.053 6.705 1.951 0.055 6.534 0.062 2.928 6.753
TP 0.962 1 0.331 0.998 1 0.395
FP 0.010 0.020 0.223 0.013 0.020 0.208
2 Accuracy 0.906 0.503 0.922 0.675 0.506 0.895 0.542 0.924 0.753 0.516
MSE 0.592 0.071 29.489 0.05 15.422 26.435 0.781 0.080 26.542 0.056 9.353 30.065
TP 1 1 0.292 1 1 0.445
FP 0.002 0.009 0.204 0.008 0.017 0.187
0.3 1 Accuracy 0.848 0.503 0.885 0.627 0.509 0.826 0.562 0.903 0.699 0.524
MSE 0.295 0.057 7.475 0.060 5.829 7.500 0.938 0.125 6.397 0.075 4.557 8.343
TP 1 1 0.238 1 0.998 0.430
FP 0.002 0.011 0.231 0.008 0.015 0.212
2 Accuracy 0.923 0.501 0.935 0.695 0.509 0.922 0.527 0.943 0.823 0.528
MSE 0.291 0.071 29.631 0.051 20.094 37.952 2.721 0.072 26.921 0.070 7.417 29.544
TP 1 1 0.264 0.986 1 0.500
FP 0.001 0.011 0.261 0.020 0.013 0.299
0.7 1 Accuracy 0.864 0.525 0.911 0.660 0.545 0.859 0.586 0.918 0.744 0.556
MSE 0.295 0.084 7.958 0.102 8.008 10.778 1.079 0.348 7.122 0.173 15.904 10.603
TP 1 1 0.293 0.982 0.980 0.388
FP 0.003 0.013 0.233 0.012 0.026 0.216
2 Accuracy 0.934 0.509 0.931 0.702 0.537 0.911 0.536 0.941 0.751 0.560
MSE 0.307 0.135 32.608 8.184 93.655 51.923 1.255 0.188 34.588 0.141 38.747 62.379
TP 1 1 0.338 1 1 0.533
FP 0.026 0.015 0.312 0.138 0.016 0.361