Table 5.
Subject and topic level scores for Bard, Generative Pre-trained Transformers (GPT)-3.5, and GPT-4.
| Subject and topic | Scores obtained | |||
|
|
Bard | GPT-3.5 | GPT-4 | |
| Overall (n=700), n (%) | 115 (16.4%)a | 145 (20.7%) | 300 (42.9%)b | |
| Biology (n=396) | ||||
|
|
Overall | 56a | 71 | 151b |
|
|
Animal kingdom | 6a | 16 | 61b |
|
|
Plant kingdom | 30b | 5a | 15 |
|
|
Ecosystem and environmental issues | 10b | 5 | 5 |
|
|
Cell biology and genetics | –1a | 19b | 19b |
|
|
Biomolecules | 2b | 2b | 2b |
|
|
Population and ecology | –1b | –6a | –1b |
|
|
Evolution and health | 1a | 11 | 26b |
|
|
Biotechnology | 9a | 19 | 24b |
| Chemistry (n=160) | ||||
|
|
Overall | 24 | 24 | 44b |
|
|
Inorganic chemistry | 15a | 25b | 20 |
|
|
Organic chemistry | 1 | –4a | 6b |
|
|
Physical chemistry | 8 | 3a | 18b |
| Physics (n=144) | ||||
|
|
Overall | 35a | 50 | 105b |
|
|
Modern physics and electronics | –4a | 6b | 6b |
|
|
Magnetism | –1a | 4 | 14b |
|
|
Simple harmonic motion and waves | 4b | –1a | 4b |
|
|
Optics | –3a | 7 | 12b |
|
|
Electrostatics and electricity | 19 | 14a | 39b |
|
|
Heat and thermodynamics | 2b | 2b | 2b |
|
|
Mechanics | 18 | 18 | 28b |
aLowest scorer within the topic.
bTop scorer within the topic.