. Author manuscript; available in PMC: 2020 Aug 26.

Published in final edited form as: Am Polit Sci Rev. 2019 May 31;113(3):838–859. doi: 10.1017/s0003055419000194

TABLE 2.

Existing Tools Cannot Declare Many Core Elements of Designs and, as a Result, Can Only Calculate Some Diagnosands

(a) Declare design elements			(b) Diagnosis capabilities
Design feature			Diagnosand
(M)	Effect and block size correlated	0/30	Power (DIM estimator)	28/30
(I)	Estimand	0/30	Power (BFE estimator)	13/30
(D)	Sampling procedure	0/30	Power (IPW-BFE estimator)	0/30
(D)	Assignment procedure	0/30	Bias (any estimator)	0/30
(D)	Block sizes vary	1/30	Coverage (any estimator)	0/30
(A)	Probability weighting	0/30	SD of estimates (any estimator)	0/30

Note: Panel (a) indicates the number of tools that allow declaration of a particular feature of the design as part of the diagnosis. In the first row, for example, 0/30indicates that no tool allows researchers to declare correlated effect and block sizes. Panel (b) indicates the number of tools that can perform a particular diagnosis. Results correspond to design tool census concluded in July 2017 and do not include tools published since then.