Table 2.
Average variable selection performance averaged across 100 simulated datasets with standard deviations in brackets
| Individual | Group | ||||||
|---|---|---|---|---|---|---|---|
| Method | MCC | TPR | TNR | MCC | TPR | TNR | |
| Sim 1 | SMT | 0.29 (0.36) | 0.22 (0.27) | 1.00 (0.00) | 0.41 (0.49) | 0.41 (0.49) | 1.00 (0.00) |
| GMT | 0.10 (0.14) | 0.36 (0.48) | 0.91 (0.11) | 0.35 (0.49) | 0.36 (0.48) | 0.99 (0.05) | |
| SGMT | 0.47 (0.39) | 0.41 (0.37) | 1.00 (0.00) | 0.60 (0.49) | 0.63 (0.49) | 0.97 (0.09) | |
| ASSET | 0.21 (0.34) | 0.16 (0.26) | 1.00 (0.00) | 0.28 (0.45) | 0.28 (0.45) | 1.00 (0.00) | |
| GPA | 0.03 (0.12) | 0.09 (0.18) | 0.93 (0.17) | 0.04 (0.18) | 0.21 (0.41) | 0.83 (0.37) | |
| SGST | 0.09 (0.21) | 0.05 (0.12) | 1 (0.00) | 0.17 (0.38) | 0.17 (0.38) | 1 (0.03) | |
| Sim 2 | SMT | 0.55 (0.15) | 0.34 (0.16) | 1.00 (0.00) | 0.88 (0.20) | 0.84 (0.25) | 0.99 (0.03) |
| GMT | 0.34 (0.08) | 0.80 (0.27) | 0.83 (0.06) | 0.85 (0.21) | 0.80 (0.27) | 1.00 (0.02) | |
| SGMT | 0.72 (0.14) | 0.56 (0.20) | 1.00 (0.00) | 0.95 (0.11) | 0.95 (0.15) | 0.99 (0.04) | |
| ASSET | 0.46 (0.19) | 0.26 (0.15) | 1.00 (0.00) | 0.74 (0.30) | 0.70 (0.33) | 0.99 (0.04) | |
| GPA | 0.22 (0.2) | 0.11 (0.12) | 0.99 (0.07) | 0.43 (0.39) | 0.39 (0.37) | 0.98 (0.14) | |
| SGST | 0.01 (0.05) | 0.00 (0.02) | 1 (0.00) | 0.03 (0.13) | 0.02 (0.1) | 1.00 (0.00) | |
| Sim 3 | SMT | 0.46 (0.08) | 0.24 (0.08) | 1.00 (0.00) | 0.91 (0.12) | 0.89 (0.16) | 0.99 (0.03) |
| GMT | 0.57 (0.03) | 0.98 (0.06) | 0.84 (0.01) | 0.99 (0.05) | 0.98 (0.06) | 1.00 (0.01) | |
| SGMT | 0.73 (0.09) | 0.59 (0.13) | 1.00 (0.00) | 0.97 (0.07) | 0.99 (0.04) | 0.99 (0.03) | |
| ASSET | 0.33 (0.11) | 0.14 (0.08) | 1.00 (0.00) | 0.77 (0.20) | 0.71 (0.26) | 0.99 (0.04) | |
| GPA | 0.23 (0.09) | 0.07 (0.04) | 1.00 (0.00) | 0.61 (0.23) | 0.49 (0.26) | 1.00 (0.01) | |
| SGST | 0.00 (0.00) | 0.00 (0.00) | 1 (0.00) | 0.00 (0.00) | 0.00 (0.00) | 1.00 (0.00) | |
| Sim 4 | SMT | 0.21 (0.05) | 0.06 (0.02) | 1.00 (0.00) | 0.70 (0.15) | 0.61 (0.17) | 0.99 (0.02) |
| GMT | 0.86 (0.02) | 1.00 (0.03) | 0.94 (0.00) | 1.00 (0.02) | 1.00 (0.03) | 1.00 (0.00) | |
| SGMT | 0.56 (0.04) | 0.38 (0.04) | 1.00 (0.00) | 0.99 (0.02) | 1.00 (0.02) | 1.00 (0.01) | |
| ASSET | 0.13 (0.08) | 0.03 (0.03) | 1.00 (0.00) | 0.46 (0.25) | 0.34 (0.24) | 0.99 (0.02) | |
| GPA | 0.11 (0.05) | 0.02 (0.01) | 1.00 (0.00) | 0.43 (0.21) | 0.28 (0.18) | 1.00 (0.01) | |
| SGST | 0.00 (0.00) | 0.00 (0.00) | 1.00 (0.00) | 0.00 (0.00) | 0.00 (0.00) | 1.00 (0.00) | |
Measures of performance are based on variable (pleiotropic) effect recovery and group effect recovery