Skip to main content
. 2017 Jan 13;67(3):282–289. doi: 10.1093/biosci/biw159

Table 2.

Questionable Research Practices (QRPs) that can inflate the false positive rate in the literature and result in less reproducible research (adapted from John et al. 2012).

P-hacking · Checking the statistical significance of results before deciding whether to collect more data
· Stopping data collection early because results reached statistical significance
· Deciding whether to exclude data points (e.g., outliers) only after foreshadowing the impact on statistical significance and not reporting the impact of the data exclusion
Rounding off a p value to meet a statistical significance threshold (e.g., presenting 0.053 as P < .05)
Cherry-picking · Failing to report dependent or response variables or relationships that did not reach statistical significance or other threshold
· Failing to report conditions or treatments that did not reach statistical significance or other threshold
HARKing (hypothesizing after the results are known) Presenting a post hoc finding as though it had been hypothesized all along