Table 4:

Counts of GeneGPT errors on different tasks.

GeneTuring Task	E1	E2	E3	E4	O
Gene alias	0	0	2	6	0
Gene location	0	0	0	17	0
SNP location	0	1	0	0	0
Gene disease association	15	0	0	3	2
DNA to human genome	0	0	7	0	42
DNA to multiple species	0	0	1	1	4
GeneHop Task	E1	E2	E3	E4	O
SNP gene function	0	0	29	0	0
Disease gene location	4	7	1	5	1
Sequence gene alias	0	30	8	0	0

E1: wrong API; E2: wrong arguments; E3: wrong comprehension; E4: unanswerable with API; O: others.