Table 3.
Participant responses regarding their user experience of artificial intelligence (AI) chatbots in vascular surgery. Only participants who have ever used or tested an AI chatbot for the specific indications were included in the analysis.
| Responses | n (%) |
|---|---|
| Have you ever used or tested an AI chatbots? | |
| Yes | 187 |
| Which AI chatbot have you ever used or tested?∗ | |
| ChatGPT (OpenAl) | 168 (89.8) |
| Bing (Microsoft) | 42 (22.5) |
| Bard (Google) | 23 (12.3) |
| Med-Palm (Google) | 3 (1.6) |
| Other | 11 (5.9) |
| Have you ever used or tested an AI chatbots for questions related to clinical practice? | |
| Yes | 80 |
| When did you use or test an AI chatbot for questions related to clinical practice? | |
| Before 2021 | 1 (1.3) |
| 2021 | 8 (10.0) |
| 2022 | 25 (31.3) |
| 2023 | 45 (56.3) |
| 2024 | 1 (1.3) |
| How often do you use AI chatbots in your clinical practice? | |
| Daily | 3 (3.8) |
| Weekly | 11 (13.8) |
| Monthly | 6 (7.5) |
| Rarely | 46 (57.5) |
| Never | 14 (17.5) |
| Have you experienced any issues or limitations using AI chatbots for clinical practice? | |
| Yes | 59 (73.8) |
| If yes, what kind of issues or limitations have you experienced?∗ | |
| Inappropriate answers from the AI chatbots | 35 (43.8) |
| Inaccurate answers from the AI chatbots | 36 (45) |
| Lack of specificity of the answers | 51 (63.8) |
| Difficulty interpreting responses | 8 (10) |
| Variability in the quality of responses | 38 (47.5) |
| Answers unavailable | 11 (13.8) |
| Lack of transparency on where the information came from | 28 (35) |
| Have you ever used or tested an AI chatbot for scientific or academic writing? | |
| Yes | 64 |
| What is your opinion on the usefulness of AI chatbots for scientific or academic writing? | |
| Very useful | 8 (12.5) |
| Somewhat useful | 21 (32.8) |
| Neutral | 13 (20.3) |
| Somewhat not useful | 13 (20.3) |
| Not useful at all | 9 (14.1) |
| Have you experienced any issues or limitations using AI chatbots for scientific or academic writing? | |
| Yes | 57 (89.1) |
| If yes, what kind of issues or limitations have you experienced?∗ | |
| Concerns about plagiarism | 29 (45.3) |
| Concerns about the quality or accuracy of the scientific content generated | 55 (85.9) |
| Concerns about lack of transparency | 21 (32.8) |
| Concerns about authorship and accountability | 33 (51.6) |
| Concerns about dependence on technology over human expertise | 18 (28.1) |
| Have you ever used or tested an AI chatbot for searching bibliography or scientific content? | |
| Yes | 64 |
| What is your opinion on the usefulness of AI chatbots for literature search? | |
| Very useful | 11 (17.2) |
| Somewhat useful | 27 (42.2) |
| Neutral | 9.0 (14.1) |
| Somewhat not useful | 12 (18.8) |
| Not useful at all | 5.0 (7.8) |
% are expressed per subgroups.
∗
Multiple answers possible.