Skip to main content
. 2021 Apr 7;49(10):2570–2592. doi: 10.1080/02664763.2021.1911966

Table 2.

Estimate of the treatment effect in the Scenario with a strong association between covariates and treatment, a weak association between covariates and outcome ( T+Y), and a sample size of 1000.

    Bias Std RMSE Coverage IC
Implementation Approach τ^21 τ^31 τ^21 τ^31 τ^21 τ^31 τ^21 τ^31
Cor.param. Crude 0.467 0.790 0.094 0.117 0.477 0.799 0.001 0.000
  stan 0.005 0.001 0.083 0.094 0.083 0.094 0.955 0.967
  IPW 0.039 0.032 0.301 0.308 0.303 0.310 0.870 0.898
  match 0.102 0.092 0.121 0.140 0.158 0.168 0.862 0.889
  BCM 0.022 0.004 0.120 0.137 0.122 0.137 0.958 0.960
  TMLE 0.006 0.002 0.101 0.118 0.102 0.118 0.952 0.960
  OW 0.009 0.004 0.104 0.116 0.105 0.116 0.967 0.975
  A-OW 0.006 0.003 0.096 0.107 0.096 0.107 0.948 0.959
Inc.param. stan −0.121 −0.039 0.098 0.113 0.155 0.120 0.785 0.928
  IPW 0.209 0.181 0.174 0.195 0.272 0.266 0.621 0.755
  match 0.132 0.118 0.121 0.136 0.179 0.180 0.799 0.869
  BCM 0.091 0.045 0.119 0.136 0.149 0.143 0.887 0.940
  TMLE 0.159 0.112 0.131 0.155 0.206 0.191 0.767 0.892
  OW 0.117 0.099 0.109 0.118 0.160 0.154 0.812 0.865
  A-OW 0.065 0.062 0.101 0.116 0.120 0.131 0.898 0.920
M.Learning stan 0.005 0.014 0.090 0.105 0.090 0.106 0.938 0.940
  IPW 0.159 0.138 0.185 0.200 0.244 0.244 0.720 0.801
  match 0.124 0.111 0.122 0.138 0.174 0.177 0.819 0.875
  BCM 0.010 0.008 0.118 0.135 0.119 0.136 0.953 0.956
  TMLE 0.016 0.006 0.106 0.123 0.108 0.124 0.939 0.945
  OW 0.080 0.067 0.110 0.121 0.136 0.138 0.893 0.912
  A-OW 0.003 −0.001 0.098 0.108 0.098 0.108 0.937 0.952

Note: Cor.param=correct parametric models, Inc.param=incorrect parametric models, M.Learning=machine learning, Crude=Unadjusted, stan=standardization, IPW=inverse probability weighting, match=matching, BCM=bias-corrected matching, TMLE=targeted maximum likelihood, OW=overlap weights, A-OW=augmented overlap weights. **: in 1 replication, the confidence intervals could not be computed.