Table 2.
Bias×100, MSE×100, type I error, and power for the weighted regression (WR) approach and doubly robust (DR) estimator with the propensity score estimated using logistic regression, GBM, and CBPS, time machine (TM), and the robust meta-analysis-predictive prior approach (RMAP) when the control arm sample size is 300.
| K=2 | K=4 | K=6 | K=8 | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Bias | MSE | Type I | Power | Bias | MSE | Type I | Power | Bias | MSE | Type I | Power | Bias | MSE | Type I | Power | |
| Scenario 1 | ||||||||||||||||
| WR Logist | −0.02 | 0.07 | 0.05 | 0.98 | −0.08 | 0.07 | 0.05 | 0.98 | −0.11 | 0.07 | 0.04 | 0.97 | −0.14 | 0.07 | 0.05 | 0.98 |
| WR GBM | −0.10 | 0.06 | 0.06 | 0.98 | −0.08 | 0.06 | 0.05 | 0.97 | −0.16 | 0.06 | 0.04 | 0.98 | −0.10 | 0.06 | 0.04 | 0.98 |
| WR CBPS | 0.01 | 0.06 | 0.05 | 0.98 | −0.01 | 0.06 | 0.04 | 0.98 | −0.01 | 0.06 | 0.05 | 0.98 | −0.03 | 0.06 | 0.05 | 0.98 |
| DR Logist | −0.06 | 0.07 | 0.01 | 0.93 | −0.08 | 0.07 | 0.01 | 0.92 | −0.15 | 0.07 | 0.01 | 0.93 | −0.17 | 0.08 | 0.01 | 0.93 |
| DR GBM | −0.14 | 0.06 | 0.01 | 0.93 | −0.16 | 0.07 | 0.01 | 0.93 | −0.11 | 0.07 | 0.01 | 0.94 | −0.10 | 0.06 | 0.01 | 0.93 |
| DR CBPS | 0.00 | 0.06 | 0.01 | 0.92 | −0.01 | 0.06 | 0.01 | 0.92 | −0.03 | 0.06 | 0.01 | 0.92 | −0.03 | 0.06 | 0.01 | 0.92 |
| TM | 0.50 | 0.10 | 0.04 | 0.96 | 0.48 | 0.10 | 0.04 | 0.96 | 0.46 | 0.10 | 0.05 | 0.96 | 0.46 | 0.11 | 0.05 | 0.96 |
| RMAP | 0.36 | 0.06 | 0.04 | 0.96 | 0.36 | 0.06 | 0.04 | 0.96 | 0.36 | 0.06 | 0.04 | 0.96 | 0.36 | 0.06 | 0.04 | 0.96 |
| Scenario 2 | ||||||||||||||||
| WR Logist | −0.21 | 0.12 | 0.05 | 0.96 | −0.52 | 0.12 | 0.05 | 0.97 | −0.69 | 0.12 | 0.05 | 0.97 | −0.92 | 0.13 | 0.06 | 0.97 |
| WR GBM | −1.11 | 0.12 | 0.05 | 0.98 | −1.13 | 0.12 | 0.06 | 0.98 | −1.37 | 0.13 | 0.06 | 0.98 | −1.46 | 0.13 | 0.06 | 0.98 |
| WR CBPS | −0.54 | 0.11 | 0.05 | 0.98 | −0.99 | 0.11 | 0.05 | 0.98 | −1.20 | 0.12 | 0.05 | 0.98 | −1.37 | 0.12 | 0.06 | 0.98 |
| DR Logist | −0.06 | 0.12 | 0.05 | 0.98 | −0.35 | 0.12 | 0.05 | 0.98 | −0.59 | 0.13 | 0.05 | 0.98 | −0.78 | 0.13 | 0.06 | 0.98 |
| DR GBM | −1.16 | 0.12 | 0.06 | 0.98 | −1.21 | 0.13 | 0.06 | 0.98 | −1.21 | 0.12 | 0.06 | 0.98 | −1.45 | 0.12 | 0.05 | 0.98 |
| DR CBPS | −0.40 | 0.11 | 0.05 | 0.98 | −0.85 | 0.11 | 0.05 | 0.98 | −1.09 | 0.12 | 0.05 | 0.98 | −1.24 | 0.12 | 0.05 | 0.98 |
| TM | −0.84 | 0.17 | 0.06 | 0.97 | −0.75 | 0.16 | 0.07 | 0.97 | −0.70 | 0.16 | 0.07 | 0.98 | −0.58 | 0.17 | 0.07 | 0.97 |
| RMAP | −3.04 | 0.28 | 0.08 | 0.95 | −3.04 | 0.28 | 0.08 | 0.95 | −3.04 | 0.28 | 0.08 | 0.95 | −3.04 | 0.28 | 0.08 | 0.95 |
| Scenario 3 | ||||||||||||||||
| WR Logist | −0.16 | 0.10 | 0.05 | 0.93 | −0.84 | 0.13 | 0.06 | 0.94 | −1.03 | 0.13 | 0.06 | 0.94 | −1.18 | 0.13 | 0.06 | 0.94 |
| WR GBM | −0.92 | 0.10 | 0.06 | 0.96 | −1.38 | 0.13 | 0.05 | 0.95 | −1.44 | 0.13 | 0.06 | 0.96 | −1.56 | 0.13 | 0.06 | 0.95 |
| WR CBPS | −0.63 | 0.09 | 0.05 | 0.96 | −1.49 | 0.11 | 0.06 | 0.96 | −1.69 | 0.12 | 0.06 | 0.96 | −1.76 | 0.12 | 0.07 | 0.96 |
| DR Logist | −0.15 | 0.10 | 0.05 | 0.95 | −0.85 | 0.13 | 0.05 | 0.95 | −1.02 | 0.14 | 0.05 | 0.95 | −1.19 | 0.14 | 0.05 | 0.95 |
| DR GBM | −0.83 | 0.10 | 0.05 | 0.94 | −1.39 | 0.12 | 0.05 | 0.95 | −1.48 | 0.13 | 0.05 | 0.95 | −1.47 | 0.12 | 0.06 | 0.95 |
| DR CBPS | −0.57 | 0.09 | 0.04 | 0.94 | −1.44 | 0.12 | 0.04 | 0.94 | −1.65 | 0.12 | 0.04 | 0.95 | −1.69 | 0.13 | 0.04 | 0.94 |
| TM | −0.29 | 0.14 | 0.06 | 0.94 | 1.05 | 0.18 | 0.04 | 0.90 | 1.59 | 0.20 | 0.03 | 0.88 | 1.97 | 0.21 | 0.03 | 0.86 |
| RMAP | −2.06 | 0.15 | 0.04 | 0.95 | −2.06 | 0.15 | 0.04 | 0.95 | −2.06 | 0.15 | 0.04 | 0.95 | −2.06 | 0.15 | 0.04 | 0.95 |