Table 3.
True Signal Ratio | 0.03 | 0.05 | 0.1 | |||||||
---|---|---|---|---|---|---|---|---|---|---|
Method | Cutoff * | Power | Sensitivity | PPV | Power | Sensitivity | PPV | Power | Sensitivity | PPV |
ROR | 1 | 0.996 | 0.753 | 0.251 | 0.997 | 0.728 | 0.394 | 0.999 | 0.680 | 0.649 |
1.5 | 0.996 | 0.704 | 0.388 | 0.997 | 0.678 | 0.534 | 0.999 | 0.621 | 0.744 | |
2 | 0.996 | 0.655 | 0.503 | 0.997 | 0.624 | 0.628 | 0.999 | 0.561 | 0.800 | |
2.5 | 0.996 | 0.608 | 0.587 | 0.997 | 0.569 | 0.692 | 0.999 | 0.498 | 0.833 | |
3 | 0.996 | 0.559 | 0.646 | 0.997 | 0.519 | 0.737 | 0.999 | 0.438 | 0.854 | |
PRR | 1 | 0.996 | 0.753 | 0.251 | 0.997 | 0.728 | 0.394 | 0.999 | 0.680 | 0.649 |
1.5 | 0.996 | 0.704 | 0.389 | 0.997 | 0.678 | 0.535 | 0.999 | 0.621 | 0.744 | |
2 | 0.996 | 0.654 | 0.504 | 0.997 | 0.623 | 0.629 | 0.999 | 0.560 | 0.800 | |
2.5 | 0.996 | 0.607 | 0.588 | 0.997 | 0.568 | 0.693 | 0.999 | 0.497 | 0.833 | |
3 | 0.996 | 0.557 | 0.647 | 0.997 | 0.516 | 0.738 | 0.999 | 0.436 | 0.855 | |
IC | 0.991 | 0.687 | 0.309 | 0.995 | 0.660 | 0.479 | 0.995 | 0.613 | 0.748 | |
0.986 | 0.612 | 0.614 | 0.991 | 0.579 | 0.757 | 0.992 | 0.526 | 0.904 | ||
0.980 | 0.541 | 0.825 | 0.984 | 0.507 | 0.881 | 0.990 | 0.448 | 0.951 | ||
0.976 | 0.500 | 0.877 | 0.982 | 0.467 | 0.917 | 0.989 | 0.405 | 0.963 | ||
0.963 | 0.413 | 0.938 | 0.977 | 0.375 | 0.956 | 0.986 | 0.311 | 0.978 | ||
LRT | 0.2 | 0.939 | 0.462 | 0.962 | 0.956 | 0.417 | 0.983 | 0.973 | 0.338 | 0.990 |
0.1 | 0.929 | 0.432 | 0.981 | 0.945 | 0.388 | 0.990 | 0.969 | 0.312 | 0.995 | |
0.05 | 0.915 | 0.409 | 0.990 | 0.930 | 0.365 | 0.992 | 0.961 | 0.289 | 0.996 | |
0.025 | 0.901 | 0.387 | 0.994 | 0.922 | 0.341 | 0.995 | 0.947 | 0.267 | 1.000 | |
0.01 | 0.881 | 0.359 | 0.997 | 0.908 | 0.314 | 0.999 | 0.932 | 0.240 | 1.000 | |
GPS | 1 | 0.891 | 0.417 | 0.997 | 0.926 | 0.395 | 0.998 | 0.951 | 0.378 | 0.997 |
1.5 | 0.888 | 0.415 | 0.998 | 0.925 | 0.393 | 0.998 | 0.951 | 0.378 | 0.997 | |
2 | 0.888 | 0.414 | 0.998 | 0.925 | 0.391 | 0.998 | 0.950 | 0.369 | 0.998 | |
2.5 | 0.888 | 0.406 | 0.998 | 0.924 | 0.373 | 0.998 | 0.945 | 0.312 | 1.000 | |
3 | 0.886 | 0.369 | 0.999 | 0.911 | 0.315 | 0.999 | 0.913 | 0.204 | 1.000 | |
BCPNN | 0.948 | 0.578 | 0.731 | 0.951 | 0.539 | 0.857 | 0.972 | 0.474 | 0.957 | |
0.914 | 0.443 | 0.984 | 0.924 | 0.398 | 0.992 | 0.950 | 0.323 | 0.998 | ||
0.867 | 0.335 | 0.998 | 0.893 | 0.291 | 0.999 | 0.911 | 0.216 | 1.000 | ||
0.808 | 0.246 | 1.000 | 0.831 | 0.204 | 1.000 | 0.837 | 0.139 | 1.000 | ||
0.719 | 0.174 | 1.000 | 0.753 | 0.138 | 1.000 | 0.754 | 0.081 | 1.000 | ||
sB | 1 | 0.934 | 0.488 | 0.866 | 0.942 | 0.448 | 0.939 | 0.939 | 0.387 | 0.988 |
1.5 | 0.921 | 0.414 | 0.992 | 0.932 | 0.363 | 0.996 | 0.919 | 0.293 | 0.999 | |
2 | 0.900 | 0.347 | 1.000 | 0.908 | 0.292 | 1.000 | 0.894 | 0.217 | 1.000 | |
2.5 | 0.864 | 0.288 | 1.000 | 0.875 | 0.231 | 1.000 | 0.856 | 0.156 | 1.000 | |
3 | 0.807 | 0.241 | 1.000 | 0.826 | 0.180 | 1.000 | 0.797 | 0.110 | 1.000 | |
TreeScan | 0.2 | 0.942 | 0.477 | 0.964 | 0.954 | 0.444 | 0.981 | 0.975 | 0.369 | 0.992 |
0.1 | 0.930 | 0.457 | 0.983 | 0.949 | 0.417 | 0.991 | 0.968 | 0.343 | 0.996 | |
0.05 | 0.917 | 0.437 | 0.990 | 0.942 | 0.393 | 0.997 | 0.955 | 0.322 | 0.998 | |
0.025 | 0.904 | 0.422 | 0.994 | 0.935 | 0.373 | 0.999 | 0.948 | 0.301 | 1.000 | |
0.01 | 0.887 | 0.400 | 0.997 | 0.914 | 0.352 | 0.999 | 0.924 | 0.280 | 1.000 |
ROR, Reporting Odds Ratio; PRR, Proportional Reporting Ratio; IC, Information Component; LRT, Likelihood ratio test; GPS, Gamma Poisson Shrinker; BCPNN, Bayesian Confidence Propagation Neural Network; sB simplified Bayes; TreeScan, Tree-based Scan Statistic; * Cutoff values for the lower bound of the 95% CI for ROR, PRR, IC, BCPNN, and sB, for EB05 for GPS, and for the p-value for LRT and TreeScan.