Table 2.
Evaluation Criteria
| Criteria | Quality Definition |
|---|---|
| Tone | Ability of chatbot to express information in a way that is appropriate for the type of information being delivered. |
| Clarity | Ability of chatbot to communicate information clearly and in a way that avoids ambiguity or confusion. |
| Program Accuracy | Ability of chatbot to provide correct information about the PGS program |
| Domain Accuracy | Ability of chatbot to provide correct information about the genetic test results and care implications |
| Robustness | Ability to handle ambiguous queries or incomplete information |
| Efficiency | Ability to provide answers that are direct, concise, and complete |
| Boundaries | Ability to avoid answering questions that are unrelated to the topic |
| Usability | Ease of interfacing with chatbot |