Table 4.
Substantive citation errors in the citations to the real (non-fabricated) works.
| GPT-3.5 | GPT-4 | |
|---|---|---|
| Number of real (non-fabricated) cited works | 101 | 340 |
| Percentage with 1 or more substantive citation errors | 43% | 24% |
| Percentage with incorrect author name(s) | 14% | 6% |
| Percentage with incorrect title of the work itself | 6% | 3% |
| Percentage with incorrect date | 22% | 16% |
| Percentage of articles with incorrect journal title | 14% | 4% |
| Percentage of articles and chapters with incorrect volume, issue, or page numbers | 34% | 13% |
| Percentage of books, chapters, and websites with incorrect publisher or organization | 9% | 3% |
Except as indicated, these values refer to all works. There is no meaningful variation among the publication types (articles, books, chapters, and websites).