Table 2.

Definition and explanation of each prompt

Prompt	Definition	Brief explanation
Input-output (IO) prompting	Input the instruction directly	Consider the following medical advice: <insert the advice> Rate the medical advice using the following criteria, and make a selection from integer 1,2,3,4 <insert the criteria>
0-shot-Chain of thought (0-COT) prompting	Use “Think it step by step” on the base of IO to steer the LLM complete reasoning.	<Describe your task> Complete the task above step by step.
Performed-Chain of thought (P-COT) prompting	Break down the task into different steps to perform what reasoning processes need to be conducted by the LLM.	<Describe your task> Complete the task above step by step: Step 1….. Step 2….. …… Show your work of each step.
Reflection of thoughts (ROT) prompting	Break down the task into different steps and steer the LLM to backtrack previous steps by let the LLM simulates the mode of discussion.	<Describe your task> Imagine 3 medical experts are completing the task above step by step: Step 1 to Step X: Each expert independently completes reasoning. After step X: Experts discuss together and backtrack previous steps and finally reach agreement.