Skip to main content
. Author manuscript; available in PMC: 2018 Nov 8.
Published in final edited form as: J Am Stat Assoc. 2017 Jun 26;113(523):1219–1227. doi: 10.1080/01621459.2017.1321545

Table 1.

Estimated mean outcome under linear generative models for functional Q-learning, Q-learning with ad hoc features, and random guessing. Results are computed from 1000 datasets of size n = 250. Monte Carlo standard errors are in the second decimal place.

Example Sparsity
EY(πopt)
EY(π^FQ)
EY(π^Qlast)
EY(π^Qmean)
EY(πRand)
(S1) Sparse 3.0 2.81 1.83 2.74 0.90
(S1) Moderate 3.0 2.86 1.79 2.86 0.90
(S2) Sparse 3.0 2.61 1.88 1.75 0.92
(S2) Moderate 3.0 2.81 1.88 1.80 0.92
(S3) Sparse 3.0 2.43 2.29 1.86 0.94
(S3) Moderate 3.0 2.58 2.40 1.87 0.94