Table 5:

Summary of mixed effects linear models predicting effects of study characteristics on perceived study quality

Perception of Study Quality	RCT					Statistical Significance					Sample Size					Pilot Designation
	Percent Difference	Estimate	SE	95%CI	ES	Percent Difference	Estimate	SE	95%CI	ES	Percent Difference	Estimate	SE	95%CI	ES	Percent Difference	Estimate	SE	95%CI	ES
Significance	1.7	0.17	0.08	(0.,0.33)	0.07	3.5	0.35	0.08	(0.19,0.51)	0.14	−0.4	−0.04	0.08	(−0.2,0.12)	0.02	0.8	0.08	0.08	(−0.08,0.24)	0.03
Rigor	11.2	1.12	0.09	(0.94,1.30)	0.44	5.4	0.54	0.09	(0.36,0.72)	0.22	−1.1	−0.11	0.09	(−0.29,0.07)	0.04	0.7	0.07	0.09	(−0.11,0.25)	0.03
Innovation	3.3	0.33	0.09	(0.15,0.52)	0.13	4.1	0.41	0.09	(0.23,0.60)	0.16	−0.2	0.02	0.09	(−0.17,0.20)	0.01	0.6	0.06	0.09	(−0.12,0.25)	0.03
Clarity	3	0.30	0.10	(0.10,0.49)	0.11	5.7	0.57	0.10	(0.37,0.76)	0.21	−0.7	−0.07	0.10	(−0.27,0.13)	0.03	1.2	0.12	0.10	(−0.08,0.31)	0.04
Further Testing	3.9	0.39	0.10	(0.20,0.59)	0.13	11.0	1.10	0.10	(0.90,1.30)	0.37	−1.2	−0.12	0.10	(−0.32,0.08)	0.04	0.2	0.02	0.10	(−0.18,0.22)	0.04
Meaningful Results	4.9	0.49	0.10	(0.30,0.69)	0.17	10.8	1.08	0.10	(0.89,1.28)	0.38	0.1	0.01	0.10	(−0.19,0.20)	0.00	−0.1	−0.01	0.10	(−0.20,0.19)	0.00

Bold font indicates statistical significance p<0.05

Abbreviations: RCT = Randomized Control Trial, SE = standard error, CI = confidence interval, ES = effect size, Cohen’s D

n = 1,355 observations across 271 individuals