Table 2.

The average value and the average cost of estimated regimes in simulated experiments. In the header, p is the dimension of patient covariates; DL refers to the proposed method using decision list; Q₁ refers to parametric Q-learning; Q₂ refers to nonparametric Q-learning; OWL₁ and OWL₂ refer to outcome weighted learning with linear kernel and Gaussian kernel, respectively; MCA refers to modified covariate approach with efficiency augmentation. OWL and MCA are not applicable under Setting V, VI and VII.

p	Setting	Value						Cost
		DL	Q1	Q2	OWL1	OWL2	MCA	DL	Q1	MCA
Continuous response
10	I	2.78	2.53	2.53	2.33	2.29	2.54	1.64	9.0	5.1
	II	2.70	2.80	2.79	2.61	2.54	2.80	1.64	9.0	5.1
	III	2.59	2.54	2.53	2.29	2.24	2.55	1.68	9.1	4.9
	IV	2.89	3.37	3.35	3.16	3.09	3.37	2.50	9.5	7.4
	V	2.90	2.67	2.59	–	–	–	1.90	9.5	–
	VI	3.98	3.46	3.95	–	–	–	1.61	9.2	–
	VII	3.22	3.75	3.73	–	–	–	2.56	9.7	–
50	I	2.76	2.51	2.36	2.21	2.19	2.53	1.80	21.3	9.2
	II	2.70	2.79	2.73	2.26	2.27	2.79	1.64	21.4	9.3
	III	2.59	2.52	2.35	2.16	2.12	2.54	1.71	23.1	9.0
	IV	2.89	3.36	3.27	2.76	2.70	3.36	2.53	25.4	14.9
	V	2.87	2.63	2.33	–	–	–	2.14	28.5	–
	VI	3.95	3.43	3.47	–	–	–	1.69	26.6	–
	VII	3.21	3.74	3.61	–	–	–	2.55	30.8	–
Binary response
10	I	0.77	0.74	0.69	0.73	0.73	0.74	1.94	8.9	4.1
	II	0.71	0.72	0.60	0.71	0.71	0.72	1.69	9.2	5.3
	III	0.73	0.73	0.68	0.72	0.72	0.73	2.10	9.2	4.7
	IV	0.71	0.76	0.66	0.75	0.74	0.75	2.40	9.6	8.4
	V	0.75	0.73	0.62	–	–	–	2.52	9.6	–
	VI	0.79	0.75	0.64	–	–	–	2.09	9.5	–
	VII	0.77	0.81	0.69	–	–	–	2.83	9.9	–
50	I	0.76	0.73	0.69	0.71	0.70	0.73	2.64	21.9	8.3
	II	0.71	0.72	0.60	0.70	0.69	0.71	1.87	26.2	6.4
	III	0.73	0.72	0.67	0.70	0.69	0.72	2.53	25.0	7.3
	IV	0.71	0.76	0.66	0.73	0.72	0.74	2.55	31.0	13.8
	V	0.74	0.72	0.61	–	–	–	3.15	30.4	–
	VI	0.78	0.75	0.63	–	–	–	2.41	29.6	–
	VII	0.76	0.81	0.68	–	–	–	2.97	35.7	–