Table 2.
ESTIMATE checklist for DCEs
ESTIMATE | Recommendation |
---|---|
Estimates |
Describe the choice of parameter estimates resulting from the model appropriately and completely, including: Whether each variable corresponds to an effects-coded level, a dummy-coded level, or a continuous change in levels Whether each variable corresponds to a main effect or interaction effect Whether continuous variables are linear or have an alternative functional form |
Stochastic |
Describe the stochastic properties of the analysis, including: The statistical distributions of parameter estimates The distribution of parameter estimates across the sample (preference heterogeneity) The variance of the estimation function, including systematic differences in variance across observations (scale heterogeneity) |
Trade-offs |
Describe the trade-offs that can be inferred from the model, including: The magnitude and direction of the attribute-level coefficients The relative importance of each attribute over the range of levels included in the experiment The rate at which respondents are willing to trade off among the attributes (marginal rate of substitution) |
Interpretation |
Provide interpretation of the results taking into account the properties of the statistical model, including: Conclusions that can be drawn directly from the results Applicability of the sample, including subgroups or segments, to the population of interest Limitations of the results |
Method |
Describe the reasons for selecting the statistical analysis method used in the analysis, including: Why the method is appropriate for analyzing the data generated by the experiment Why the method is appropriate for addressing the underlying research question Why the method was selected over alternative methods |
Assumptions |
Describe the assumptions of the model and the implications of the assumptions for interpreting the results, including: Assumptions about the error distribution Assumptions about the independence of observations Assumptions about the functional form of the value function |
Transparent |
Describe the study in a sufficiently transparent way to warrant replication, including descriptions of: The data setup, including handling missing data The estimation function, including the value function and the statistical analysis method The software used for estimation |
Evaluation |
Provide an evaluation of the appropriateness of the statistical analysis method to answering the research question, including: The goodness of fit of the model Sensitivity analysis of the model specification Consistency of results estimated using different method |