Table 3.

Nudge research by research setting.

	Percentage of effects associated with this setting	Mean Cohen’ s d	Percentage of effects with p < 0.05	Percentage of effects with p < 0.10	Percentage of p-curves with evidential value (p < 0.05)
Field observation (field experiment or observational study)	44.0%	0.320	66.0%	70.0%	100%
Laboratory experiment, online experiment, or survey	56.0%	0.481	60.1%	65.3%	100%

Percentage of effects associated with this setting is a weighted mean, with an observation’s weight proportional to the inverse of the number of observations associated with the same article. Mean Cohen’s d and percentage of effects with p < 0.05 (p < 0.10) are weighted means, with an observation’s weight proportional to the inverse of the number of non-missing observations associated with the same article and with the setting named in the leftmost column. For the p-curve analysis, we randomly sample one observation per article and calculate the p-value for the null hypothesis that the random sample does not have evidential value. We repeat this procedure for 50 independent random samples and report the fraction of samples for which p < 0.05.