Official websites use .gov
A
.gov website belongs to an official
government organization in the United States.
Secure .gov websites use HTTPS
A lock (
) or https:// means you've safely
connected to the .gov website. Share sensitive
information only on official, secure websites.
Summary of performance by legal subject area.
| legal subject area | GPT-4 | ChatGPT | GPT-3.5 | NCBE student avg. |
|---|---|---|---|---|
| civil procedure | 61.1% | 34.9% | 39.1% | 59% |
| constitutional law | 69.4% | 54.2% | 45.9% | 72% |
| contracts | 88.1% | 48.5% | 37.0% | 70% |
| criminal law and procedure | 81.1% | 46.3% | 49.8% | 71% |
| evidence | 85.2% | 49.8% | 45.7% | 65% |
| real property | 79.7% | 67.8% | 52.9% | 65% |
| torts | 64.9% | 43.2% | 45.7% | 71% |
| average accuracy | 75.7% | 49.2% | 45.1% | 68.0% |
