Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Comparison of PREview answers by chatbot model
| Answer | Points | GPT-3.5, n (%) | GPT-4, n (%) | Test statistic, p-value |
|---|---|---|---|---|
| Correct | + 2 | 78 (42%) | 103 (55%) | χ2 = 12.10, p = 0.017 |
| Partial | + 1 | 101 (54%) | 80 (43%) | |
| Incorrect | 0 | 7 (4%) | 3 (2%) | |
| Total | 186 | 186 | ||
| Very ineffective | – | 26 (14%) | 12 (6%) | χ2 = 118.87, p < 0.001 |
| Ineffective | – | 40 (22%) | 63 (34%) | |
| Effective | – | 120 (65%) | 57 (31%) | |
| Very effective | – | 0 (0%) | 54 (29%) |
Statistically significant relationships (p < 0.05) determined through χ2 tests are bolded
