Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
The number of questions on which models provided the same answer regardless of the test language for temperature parameter equal to 1.
| S22 | A22 | S23 | |
|---|---|---|---|
| GPT-3.5 | 116 (79) | 113 (85) | 111 (86) |
| GPT-4 | 159 (133) | 162 (143) | 168 (148) |
In brackets, the number of correct answers with the same response is presented.
