Table 3.
Effects on cognitive reflection
| Reflection scores (%) | vs. Overall control | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| 0 | 1 | 2 | 3 | 4 | 5 | t | p | d | |
| Controls | |||||||||
| Passive control: | 14.9 | 19.8 | 15.8 | 24.8 | 18.8 | 5.9 | |||
| Active control: | 22.4 | 20.0 | 14.6 | 14.6 | 17.1 | 11.2 | |||
| Overall control: | 18.7 | 19.9 | 15.2 | 19.7 | 17.9 | 8.6 | |||
| Single-response intuition | |||||||||
| Intuition recall: | 18.2 | 20.2 | 18.2 | 20.7 | 16.3 | 6.4 | -0.61 | .541 | 0.05 |
| Emotion induction: | 30.2 | 27.7 | 20.8 | 12.4 | 6.9 | 2.0 | -6.12 | < .001 | 0.53 |
| 10s time pressure: | 28.2 | 27.2 | 16.3 | 12.9 | 10.9 | 4.5 | -4.41 | < .001 | 0.38 |
| 5s time pressure: | 28.6 | 28.1 | 19.7 | 13.8 | 5.4 | 4.4 | -5.39 | < .001 | 0.46 |
| High cognitive load: | 23.6 | 23.1 | 15.9 | 17.3 | 13.9 | 6.3 | -2.23 | .026 | 0.19 |
| Very high cognitive load: | 25.4 | 22.0 | 16.3 | 18.2 | 12.4 | 5.7 | -2.70 | .007 | 0.23 |
| Single-response reflection | |||||||||
| Reason recall: | 17.8 | 14.9 | 17.8 | 21.8 | 19.8 | 7.9 | 0.71 | .479 | 0.06 |
| Reason induction: | 18.0 | 20.4 | 17.5 | 18.0 | 15.1 | 11.2 | 0.08 | .933 | 0.01 |
| 10s time delay: | 20.3 | 16.3 | 21.3 | 15.8 | 15.8 | 10.4 | -0.17 | .869 | 0.01 |
| 20s time delay: | 17.8 | 22.3 | 15.4 | 14.4 | 18.8 | 11.4 | 0.20 | .843 | 0.02 |
| Monetary incentives: | 16.3 | 12.8 | 19.7 | 16.8 | 21.7 | 12.8 | 2.09 | .037 | 0.18 |
| Decision justification: | 18.2 | 11.0 | 20.1 | 15.3 | 19.6 | 15.8 | 2.18 | .030 | 0.19 |
| Short debiasing training: | 15.6 | 7.8 | 17.6 | 22.4 | 18.5 | 18.1 | 3.63 | < .001 | 0.31 |
| Long debiasing training: | 6.9 | 9.3 | 18.6 | 16.2 | 23.5 | 25.5 | 6.79 | < .001 | 0.58 |
| Standard two-response | |||||||||
| 5s time pressure: | 27.1 | 31.0 | 14.8 | 9.9 | 11.8 | 5.4 | -4.51 | < .001 | 0.39 |
| 10s time delay: | 23.2 | 19.2 | 18.2 | 14.3 | 12.3 | 12.8 | 0.97 | .332 | 0.08 |
| Modified two-response | |||||||||
| 5s time pressure: | 21.5 | 29.5 | 21.5 | 16.0 | 9.0 | 2.5 | -4.18 | < .001 | 0.36 |
| Justification + 10s time delay: | 17.5 | 20.5 | 18.5 | 19.0 | 15.0 | 9.5 | 0.15 | .881 | 0.01 |
The table shows the distributions of reflection scores (%) as well as the t-statistics, p-values, and effect sizes (Cohen’s ds) for two-tailed independent samples t-tests comparing the reflection scores for each intuition and reflection manipulation across the single-response and the two-response conditions with the reflection scores in the overall control (i.e., the pool of passive and active control conditions)