Table 2.
Within-participant comparisons for advice evaluations (study 2). Table 2 presents the mean evaluations for human (vs. AI) generated advice in study 2. The columns represent the mean evaluations for ChatGPT and human-generated advice (“M”) and their corresponding standard deviations (“SD”). The right-hand side shaded portion of the table presents the results of within-participant t-tests with the mean difference between the variables, with associated t-statistic, p-value, 95% confidence interval (“Lower CI” and “Upper CI”), and Cohen’s d effect sizes.
| Variable | TARGET | Mean diff. | t | p-value | Cohen’s d | Lower CI | Upper CI | |||
|---|---|---|---|---|---|---|---|---|---|---|
| ChatGPT | Human | |||||||||
| M | SD | M | SD | |||||||
| Effectiveness | 5.89 | 1.02 | 5.23 | 1.61 | 0.67 | 4.83 | < .001 | 0.37 | 0.39 | 0.94 |
| Quality | 6.02 | 1.05 | 4.98 | 1.67 | 1.04 | 7.06 | < .001 | 0.54 | 0.75 | 1.33 |
| Authenticity | 6.01 | 1.07 | 5.62 | 1.46 | 0.39 | 2.82 | .005 | 0.22 | 0.12 | 0.66 |