Table 1.

Examples of the validation questions, answers output by the system, and results

Examples of validation question (Original text was in Japanese)	Answer in system	Question-author’s answers	System answersa		System confidence	Judgment
Can I use Daikenchuto for patients with high AST and ALT? 大建中湯はAST,ALTが高い人に使ってもいいですか?	Yes	Daikenchuto and liver dysfunction	Daikenchuto and liver dysfunction	〇	95.2%	Correct	TP
In what patients is Shakuyakukanzoto contraindicated? 芍薬甘草湯の禁忌はどんな患者さんですか?	Yes	Contraindications to Shakuyakukanzoto	Indication of Shakuyakukanzoto	×	71.4%	Incorrect	FN
Can I give Yokukansan to patients with gastrointestinal upset? 胃腸の調子が良くない患者さんに抑肝散を使ってもいいですか?	Yes	Careful administration of Yokukansan	I do not have an answer.c	△	45.6%	Incorrect	FNb
Please tell me the crude drug that has a diuretic effect in Rikkunshito. 六君子湯の中で利水利尿作用のある生薬を教えてください。	No	-	I do not have an answer.c	△	40.5%	Correct	TNb
How many grams of licorice can I take in a day when I take Yokukansan? 抑肝散の一日の甘草の量は何グラムまでならよいですか?	No	-	Yokukansan package	×	95.5%	Incorrect	FP

^a 〇 means the results of the system were expected. △ means results of the system were “I do not have an answer.“ × means results of the system were unexpected

^bWhen the threshold of confidence rate is set to 61%

TP True positive; FN False negative; TN True negative; FN False negative