Table 1.
Evaluation of the Reponses of Large Language Model Platforms
| Criteria | ChatGPT (Open AI) | Bing AI (Microsoft) | Google's BARD |
|---|---|---|---|
| The large language model provides accurate answers to questions. | [ ] 1—Strongly disagree [ ] 2—Disagree [ ] 3—Neither agree or disagree [x] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [ ] 2—Disagree [x] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [ ] 2—Disagree [ ] 3—Neither agree or disagree [x] 4—Agree [ ] 5—Strongly agree |
| The large language model is reliable when generating factual information. | [ ] 1—Strongly disagree [ ] 2—Disagree [ ] 3—Neither agree or disagree [x] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [ ] 2—Disagree [x] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [ ] 2—Disagree [ ] 3—Neither agree or disagree [x] 4—Agree [ ] 5—Strongly agree |
| The large language model is proficient at understanding complex questions and providing appropriate answers. | [ ] 1—Strongly disagree [ ] 2—Disagree [ ] 3—Neither agree or disagree [x] 4—Agree [ ] 5—Strongly agree |
[x] 1—Strongly disagree [ ] 2—Disagree [ ] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [x] 2—Disagree [ ] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
| The large language model provides comprehensive information when answering questions. | [ ] 1—Strongly disagree [ ] 2—Disagree [ ] 3—Neither agree or disagree [x] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [x] 2—Disagree [ ] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [ ] 2—Disagree [ ] 3—Neither agree or disagree [x] 4—Agree [ ] 5—Strongly agree |
| The large language model generates content that covers all relevant aspects of a subject. | [ ] 1—Strongly disagree [ ] 2—Disagree [ ] 3—Neither agree or disagree [x] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [x] 2—Disagree [ ] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [ ] 2—Disagree [x] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
| The large language model is able to provide in-depth information for a wide range of topics. | [ ] 1—Strongly disagree [ ] 2—Disagree [ ] 3—Neither agree or disagree [x] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [x] 2—Disagree [ ] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [ ] 2—Disagree [x] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
| The large language model is a valuable source of general knowledge. | [ ] 1—Strongly disagree [ ] 2—Disagree [ ] 3—Neither agree or disagree [ ] 4—Agree [x] 5—Strongly agree |
[ ] 1—Strongly disagree [x] 2—Disagree [ ] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [ ] 2—Disagree [ ] 3—Neither agree or disagree [x] 4—Agree [ ] 5—Strongly agree |
| The large language model is well-versed in a variety of subjects. | [ ] 1—Strongly disagree [ ] 2—Disagree [ ] 3—Neither agree or disagree [ ] 4—Agree [x] 5—Strongly agree |
[ ] 1—Strongly disagree [x] 2—Disagree [ ] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [ ] 2—Disagree [ ] 3—Neither agree or disagree [x] 4—Agree [ ] 5—Strongly agree |
| The large language model can provide useful insights and perspectives on various topics. | [ ] 1—Strongly disagree [ ] 2—Disagree [ ] 3—Neither agree or disagree [x] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [x] 2—Disagree [ ] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [ ] 2—Disagree [x] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
| The large language model rarely makes errors when referencing sources. | [ ] 1—Strongly disagree [x] 2—Disagree [ ] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [ ] 2—Disagree [x] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [x] 2—Disagree [ ] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
| The large language model is consistent in providing accurate citations. | [ ] 1—Strongly disagree [x] 2—Disagree [ ] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [ ] 2—Disagree [x] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |
[ ] 1—Strongly disagree [ ] 2—Disagree [x] 3—Neither agree or disagree [ ] 4—Agree [ ] 5—Strongly agree |