Table 4.
True Signal Ratio | 0.03 | 0.05 | 0.1 | |||||||
---|---|---|---|---|---|---|---|---|---|---|
Method | Cutoff * | Power | Sensitivity | PPV | Power | Sensitivity | PPV | Power | Sensitivity | PPV |
ROR | 1 | 0.987 | 0.518 | 0.164 | 0.997 | 0.510 | 0.262 | 0.995 | 0.464 | 0.437 |
1.5 | 0.984 | 0.419 | 0.250 | 0.997 | 0.408 | 0.364 | 0.995 | 0.362 | 0.531 | |
2 | 0.971 | 0.323 | 0.316 | 0.996 | 0.313 | 0.437 | 0.995 | 0.268 | 0.581 | |
2.5 | 0.934 | 0.243 | 0.348 | 0.984 | 0.231 | 0.468 | 0.994 | 0.190 | 0.597 | |
3 | 0.864 | 0.177 | 0.353 | 0.943 | 0.163 | 0.467 | 0.984 | 0.133 | 0.591 | |
PRR | 1 | 0.987 | 0.518 | 0.164 | 0.997 | 0.510 | 0.262 | 0.995 | 0.464 | 0.437 |
1.5 | 0.984 | 0.419 | 0.250 | 0.997 | 0.408 | 0.364 | 0.995 | 0.361 | 0.532 | |
2 | 0.971 | 0.322 | 0.317 | 0.996 | 0.312 | 0.437 | 0.995 | 0.267 | 0.582 | |
2.5 | 0.933 | 0.241 | 0.349 | 0.984 | 0.229 | 0.469 | 0.994 | 0.189 | 0.597 | |
3 | 0.861 | 0.175 | 0.354 | 0.940 | 0.162 | 0.467 | 0.983 | 0.132 | 0.591 | |
IC | 0.944 | 0.472 | 0.182 | 0.984 | 0.469 | 0.290 | 0.984 | 0.413 | 0.486 | |
0.901 | 0.334 | 0.378 | 0.969 | 0.331 | 0.527 | 0.976 | 0.284 | 0.702 | ||
0.835 | 0.222 | 0.582 | 0.942 | 0.217 | 0.696 | 0.965 | 0.179 | 0.811 | ||
0.782 | 0.175 | 0.662 | 0.905 | 0.165 | 0.759 | 0.946 | 0.129 | 0.850 | ||
0.569 | 0.087 | 0.744 | 0.716 | 0.077 | 0.820 | 0.828 | 0.056 | 0.882 | ||
LRT | 0.2 | 0.673 | 0.149 | 0.867 | 0.785 | 0.136 | 0.917 | 0.859 | 0.111 | 0.955 |
0.1 | 0.602 | 0.122 | 0.911 | 0.725 | 0.111 | 0.948 | 0.815 | 0.089 | 0.981 | |
0.05 | 0.554 | 0.104 | 0.939 | 0.670 | 0.091 | 0.975 | 0.748 | 0.071 | 0.988 | |
0.025 | 0.509 | 0.088 | 0.966 | 0.609 | 0.077 | 0.984 | 0.679 | 0.057 | 0.992 | |
0.01 | 0.444 | 0.071 | 0.977 | 0.534 | 0.060 | 0.987 | 0.612 | 0.044 | 0.999 | |
GPS | 1 | 0.430 | 0.079 | 0.983 | 0.611 | 0.095 | 0.989 | 0.704 | 0.090 | 0.992 |
1.5 | 0.051 | 0.008 | 1.000 | 0.250 | 0.026 | 0.996 | 0.561 | 0.047 | 0.999 | |
2 | 0.028 | 0.005 | 1.000 | 0.165 | 0.017 | 1.000 | 0.465 | 0.034 | 0.999 | |
2.5 | 0.015 | 0.002 | 1.000 | 0.065 | 0.005 | 1.000 | 0.057 | 0.002 | 1.000 | |
3 | 0.003 | 0.000 | 1.000 | 0.008 | 0.001 | 1.000 | 0.003 | 0.000 | 1.000 | |
BCPNN | 0.864 | 0.306 | 0.477 | 0.914 | 0.292 | 0.624 | 0.943 | 0.259 | 0.802 | |
0.640 | 0.135 | 0.915 | 0.745 | 0.121 | 0.937 | 0.824 | 0.098 | 0.976 | ||
0.339 | 0.048 | 0.984 | 0.426 | 0.040 | 0.996 | 0.507 | 0.028 | 1.000 | ||
0.113 | 0.013 | 1.000 | 0.140 | 0.010 | 1.000 | 0.166 | 0.006 | 1.000 | ||
0.022 | 0.003 | 1.000 | 0.026 | 0.002 | 1.000 | 0.025 | 0.001 | 1.000 | ||
sB | 1 | 0.669 | 0.171 | 0.860 | 0.743 | 0.161 | 0.927 | 0.778 | 0.133 | 0.969 |
1.5 | 0.472 | 0.080 | 0.991 | 0.569 | 0.072 | 0.995 | 0.628 | 0.052 | 0.997 | |
2 | 0.247 | 0.031 | 0.996 | 0.294 | 0.024 | 1.000 | 0.345 | 0.015 | 1.000 | |
2.5 | 0.084 | 0.009 | 1.000 | 0.094 | 0.006 | 1.000 | 0.098 | 0.003 | 1.000 | |
3 | 0.016 | 0.002 | 1.000 | 0.021 | 0.001 | 1.000 | 0.018 | 0.001 | 1.000 | |
TreeScan | 0.2 | 0.671 | 0.148 | 0.866 | 0.772 | 0.137 | 0.919 | 0.843 | 0.110 | 0.945 |
0.1 | 0.619 | 0.125 | 0.930 | 0.726 | 0.114 | 0.965 | 0.792 | 0.088 | 0.964 | |
0.05 | 0.573 | 0.107 | 0.961 | 0.671 | 0.096 | 0.982 | 0.729 | 0.073 | 0.983 | |
0.025 | 0.520 | 0.092 | 0.970 | 0.614 | 0.082 | 0.990 | 0.685 | 0.061 | 0.991 | |
0.01 | 0.452 | 0.074 | 0.985 | 0.550 | 0.065 | 0.993 | 0.609 | 0.048 | 0.995 |
ROR, Reporting Odds Ratio; PRR, Proportional Reporting Ratio; IC, Information Component; LRT, Likelihood ratio test; GPS, Gamma Poisson Shrinker; BCPNN, Bayesian Confidence Propagation Neural Network; sB simplified Bayes; TreeScan, Tree-based Scan Statistic; * Cutoff values for the lower bound of the 95% CI for ROR, PRR, IC, BCPNN, and sB, for EB05 for GPS, and for the p-value for LRT and TreeScan.