Table 5.

Estimate of treatment effect in plasmode simulation using 2000 observations. True effects are ${\tau }_{21}=-0.099$, ${\tau }_{31}=0.011$, ${\tau }_{41}=-0.012$ and ${\tau }_{51}=0.003$ for all methods except OW and A−OW and ${\tau }_{21}=-0.101$, ${\tau }_{31}=0.024$, ${\tau }_{41}=-0.003$ and ${\tau }_{51}=0.002$ for the these two methods. HAC1H is the reference category . ${\tau }_{21}$, ${\tau }_{31}$, ${\tau }_{41}$ and ${\tau }_{51}$ refer to treatment effect associated to Air tanker, Ground-based action, HAC1F and HAC1R, respectively.

		Bias				RMSE				Coverage IC
Implementation	Approach	${\hat{\tau }}_{21}$	${\hat{\tau }}_{31}$	${\hat{\tau }}_{41}$	${\hat{\tau }}_{51}$	${\hat{\tau }}_{21}$	${\hat{\tau }}_{31}$	${\hat{\tau }}_{41}$	${\hat{\tau }}_{51}$	${\hat{\tau }}_{21}$	${\hat{\tau }}_{31}$	${\hat{\tau }}_{41}$	${\hat{\tau }}_{51}$
Parametric	Crude	−0.164	−0.027	−0.021	−0.035	0.168	0.045	0.050	0.045	0.002	0.897	0.941	0.786
	stan	0.004	0.028	0.009	−0.005	0.029	0.043	0.041	0.026	0.921	0.800	0.939	0.942
	IPW	−0.005	0.011	0.003	−0.002	0.040	0.048	0.050	0.029	0.957	0.902	0.947	0.963
	match	0.040	−0.004	0.023	0.004	0.050	0.043	0.052	0.042	0.279	0.428	0.335	0.398
	BCM	0.004	0.003	0.002	−0.013	0.045	0.052	0.053	0.055	0.406	0.353	0.324	0.326
	TMLE	−0.006	0.012	0.001	−0.005	0.037	0.044	0.044	0.028	0.935	0.859	0.926	0.951
	OW	0.001	0.005	0.009	0.004	0.041	0.045	0.049	0.033	0.955	0.902	0.936	0.966
	A-OW	−0.006	0.021	0.007	−0.005	0.040	0.048	0.046	0.032	0.942	0.859	0.943	0.942
Machine
learning	stan	0.007	0.027	0.008	−0.006	0.030	0.043	0.041	0.026	0.923	0.847	0.941	0.944
	IPW	−0.027	0.009	−0.001	−0.012	0.048	0.040	0.046	0.031	0.908	0.924	0.956	0.954
	match	0.028	−0.008	0.019	0.000	0.041	0.037	0.048	0.039	0.401	0.485	0.360	0.459
	BCM	0.001	0.007	0.006	−0.007	0.042	0.044	0.048	0.050	0.436	0.393	0.349	0.367
	TMLE	−0.003	0.018	0.007	−0.004	0.035	0.043	0.042	0.027	0.932	0.837	0.925	0.942
	OW	−0.028	0.000	−0.007	−0.011	0.047	0.040	0.048	0.032	0.899	0.916	0.952	0.959
	A-OW	−0.005	0.025	0.009	−0.004	0.035	0.047	0.045	0.028	0.935	0.824	0.930	0.948

Note: Crude=Unadjusted, stan=standardization, IPW=inverse probability weighting, match=matching, BCM=bias-corrected matching, TMLE=targeted maximum likelihood, OW=overlap weights, A-OW=augmented overlap weights.