Table 2:
Rating scales and prompts presented to participants with each abstract.
Significance | Rate the significance of the crucial scientific question, knowledge gap, or area of importance from not at all significant (1) to very significant (10). |
Methodological Rigor | Was the overall design, methodology, measures, and analyses appropriate and rigorous on a scale from not at all rigorous (1) to very rigorous (10)? |
Innovation | Is the study novel or creative in a way that moves behavioral science forward on a scale from not at all innovative (1) to very innovative (10)? |
Further Testing | Do these findings warrant the further testing of this intervention in a fully powered, definitive study from very low probability (1) to very high probability (10)? |
Subsequent Meaningful Results | Based on these findings, what is the probability of obtaining meaningful results in a subsequent fully powered, definitive study of this intervention from not at all warranted (1) to highly warranted (10)? |
Clarity | Rate the clarity and quality of the writing from not at all clear (1) to very clear (10). |