Table 8:

Clinician-annotated hallucinations.

Evidence	Hallucination Explanation		Query	Sorting	Seen	Rating
The patient has a bleeding colon lesion.	Yes	The report indicates that the patient used to have a bleeding colon lesion but no longer does.	cancer	Log Odds Sorting	Yes	Useful
The patient has a history of heart failure.	Yes	The report looks like it is cut off, and the only thing mentioned is a Coronary artery bypass graft (CABG).	a low ejection fraction	Log Odds Sorting	Yes	Useful
The patient has a history of sepsis.	Yes	Report says “R/O” meaning rule out sepsis.	pneumonia	LLM Confidence	No	Weakly Correlated
The patient has a mass in her breast.	Partially	The report header says that the patient has a mass, but the body of the report does not indicate this.	cancer	Log Odds Sorting	Yes	Weakly Correlated
The patient had a brain tumor removed.	Partially	Clinicians do not usually refer to pituitary adenomas (which the report indicates) as brain tumors.	neuralogical problems	Log Odds Sorting	Yes	Useful