Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Accuracy by cognitive level for AI models.
| AI Model | Odds Ratio | 95% Confidence Interval | P-value |
|---|---|---|---|
| ChatGPT-4o | 1.166 | [0.522, 2.605] | 0.709 |
| Llama 70B | 0.358 | [0.170, 0.754] | 0.007a |
| Llama 405B | 1.379 | [0.630, 3.018] | 0.421 |
Only Llama 3.1 70B showed a significant decrease in odds of answering questions belonging to cognitive level 2 (n = 61) correctly compared to cognitive level 1 (n = 193).
Statistically significant.
