Table 3.
Results on variable selection of sequential advantage selection (SAS), S-score and LASSO methods for the scenarios with the second choice of β (eight important prescriptive variables: X1, X9, X10, X20, X22, X30, X35 and X40). Size is the number of covariates selected. For S-score method, Size S ≠ 0 is the number of covariates with nonzero S-scores. TDR stands for true discovery rate, which is the proportion correctly identified important variables among all the selected variables. TP stands for true positive, which is the number of correctly identified important variables among X1, X9, X10, X20, X22, X30, X35 and X40. The quantity in parenthesis is standard deviation of corresponding value.
| Setting | SAS | S score | LASSO | ||||||
|---|---|---|---|---|---|---|---|---|---|
| Size | TDR | TP | Size S ≠ 0 | TDR | TP | Size | TDR | TP | |
| Randomized Study | |||||||||
| Model I, ρ = 0.2 | 8.66 (2.28) | 0.77 (0.17) | 6.36 (1.17) | 775.90 (166.25) | 0.44 (0.14) | 3.63 (0.80) | 32.26 (22.67) | 0.23 (0.16) | 4.99 (1.28) |
| Model I, ρ = 0.5 | 6.84 (1.64) | 0.85 (0.15) | 5.63 (0.84) | 776.29 (164.99) | 0.51 (0.15) | 3.38 (0.81) | 32.05 (20.32) | 0.22 (0.13) | 5.03 (1.06) |
| Model I, ρ = 0.8 | 5.91 (1.13) | 0.86 (0.15) | 4.98 (0.85) | 772.77 (164.44) | 0.29 (0.10) | 1.68 (0.61) | 32.80 (18.94) | 0.19 (0.11) | 4.80 (1.07) |
| Model II, ρ = 0.2 | 8.42 (2.22) | 0.77 (0.18) | 6.22 (1.17) | 773.33 (160.75) | 0.48 (0.15) | 3.81 (0.81) | 34.29 (22.01) | 0.22 (0.13) | 5.32 (1.20) |
| Model II, ρ = 0.5 | 6.45 (1.37) | 0.89 (0.13) | 5.61 (0.91) | 776.16 (163.31) | 0.55 (0.15) | 3.42 (0.81) | 34.45 (22.52) | 0.21 (0.12) | 5.30 (1.05) |
| Model II, ρ = 0.8 | 5.65 (0.91) | 0.89 (0.13) | 5.00 (0.79) | 773.70 (164.49) | 0.29 (0.11) | 1.64 (0.59) | 35.02 (20.24) | 0.18 (0.10) | 4.95 (1.01) |
| Model III, ρ = 0.2 | 11.07 (3.40) | 0.59 (0.21) | 5.94 (1.34) | 775.56 (164.35) | 0.38 (0.15) | 3.82 (0.87) | 31.92 (23.53) | 0.23 (0.15) | 4.91 (1.32) |
| Model III, ρ = 0.5 | 9.32 (2.92) | 0.64 (0.20) | 5.44 (1.01) | 775.36 (163.33) | 0.43 (0.15) | 3.67 (0.84) | 33.28 (24.79) | 0.22 (0.14) | 4.95 (1.19) |
| Model III, ρ = 0.8 | 6.83 (1.83) | 0.743 (0.20) | 4.80 (0.91) | 774.23 (164.92) | 0.28 (0.10) | 1.90 (0.69) | 31.35 (18.45) | 0.20 (0.13) | 4.58 (1.16) |
|
| |||||||||
| Observational Study | |||||||||
| Model I, ρ = 0.2 | 9.11 (2.10) | 0.76 (0.14) | 6.70 (1.06) | 773.35 (164.86) | 0.49 (0.15) | 4.24 (0.81) | 50.38 (28.30) | 0.182 (0.09) | 7.11 (0.87) |
| Model I, ρ = 0.5 | 7.22 (1.54) | 0.83 (0.13) | 5.82 (0.86) | 779.48 (160.39) | 0.55 (0.14) | 3.84 (0.76) | 42.70 (24.25) | 0.20 (0.10) | 6.56 (0.74) |
| Model I, ρ = 0.8 | 6.21 (1.11) | 0.80 (0.13) | 4.91 (0.80) | 784.01 (157.62) | 0.29 (0.1) | 1.76 (0.61) | 40.94 (19.95) | 0.18 (0.09) | 6.02 (0.55) |
| Model II, ρ = 0.2 | 8.25 (2.18) | 0.80 (0.18) | 6.34 (1.18) | 705.38 (185.85) | 0.56 (0.16) | 4.34 (0.84) | 48.10 (26.87) | 0.19 (0.10) | 7.12 (0.91) |
| Model II, ρ = 0.5 | 6.57 (1.65) | 0.89 (0.14) | 5.66 (0.95) | 743.78 (175.07) | 0.60 (0.14) | 3.81 (0.79) | 43.33 (25.16) | 0.20 (0.10) | 6.58 (0.74) |
| Model II, ρ = 0.8 | 5.61 (0.79) | 0.91 (0.12) | 5.05 (0.77) | 772.98 (161.88) | 0.29 (0.1) | 1.60 (0.55) | 40.99 (19.20) | 0.18 (0.07) | 6.04 (0.56) |
| Model III, ρ = 0.2 | 10.95 (3.11) | 0.64 (0.18) | 6.55 (1.19) | 746.16 (175.46) | 0.43 (0.14) | 4.33 (0.86) | 49.26 (28.36) | 0.19 (0.09) | 7.21 (0.84) |
| Model III, ρ = 0.5 | 9.77 (3.08) | 0.63 (0.19) | 5.69 (1.06) | 756.17 (167.10) | 0.45 (0.15) | 4.06 (0.84) | 44.53 (25.24) | 0.19 (0.10) | 6.68 (0.81) |
| Model III, ρ = 0.8 | 7.22 (2.01) | 0.70 (0.18) | 4.79 (0.88) | 770.29 (161.25) | 0.29 (0.09) | 2.06 (0.78) | 41.58 (19.64) | 0.18 (0.08) | 6.15 (0.65) |