Table 1.
Evaluation of perceptions on ChatGPT-assisted training in biomedical informatics. Values for items other than age represent scores on a 5-point Likert scale (from 1=strongly agree to 5=strongly disagree).
| Item | Men, mean (SD) | P value | Women, mean (SD) | P value | All | P valuea | ||
|
|
Undergraduates (n=41) | Graduates (n=21) |
|
Undergraduates (n=47) | Graduates (n=43) |
|
|
|
| Age (years) | 20.1 (1.27) | 28.4 (6.68) | <.001 | 20.1 (1.42) | 27.5 (7.13) | <.001 | 23.3 (5.98) | .12 |
| Q1: I believe that using ChatGPT to assist with training will allow me to gain more knowledge than traditional training approaches. | 3.66 (0.825) | 4.48 (0.602) | <.001 | 3.74 (0.765) | 4.09 (0.684) | .03 | 3.92 (0.785) | .85 |
| Q2: I believe that using ChatGPT to assist training will help me understand the code content better than traditional training approaches. | 3.61 (0.862) | 4.10 (0.768) | .03 | 3.60 (0.771) | 3.98 (0.707) | .02 | 3.78 (0.799) | .98 |
| Q3: In comparison to traditional training approaches, I believe that using ChatGPT to assist training will make it easier for me to write the analysis programming I want. | 3.61 (0.891) | 4.14 (0.910) | .03 | 3.68 (0.726) | 4.00 (0.756) | .04 | 3.82 (0.825) | .75 |
| Q4: I believe that using ChatGPT-assisted training will increase my desire to do independent training more than traditional training methods. | 3.59 (0.974) | 4.24 (0.995) | .02 | 3.43 (0.827) | 3.95 (1.05) | .009 | 3.73 (0.990) | .43 |
| Q5: I believe that using ChatGPT to assist training will increase my motivation to train when compared to traditional training approaches. | 3.51 (0.925) | 4.14 (0.964) | .02 | 3.43 (0.773) | 4.09 (0.840) | <.001 | 3.74 (0.912) | .90 |
| Q6: I believe that using ChatGPT to assist with training will help me better understand the complex and difficult parts of training material than traditional training approaches. | 3.51 (1.00) | 4.14 (0.910) | .02 | 3.47 (0.776) | 3.81 (0.906) | .05 | 3.67 (0.919) | .54 |
| Q7: I believe that using ChatGPT-assisted training will increase my motivation to practice more when compared to traditional training approaches. | 3.63 (0.915) | 4.33 (0.856) | .005 | 3.57 (0.903) | 3.95 (0.844) | .04 | 3.80 (0.914) | .45 |
| Q8: I believe that using ChatGPT-assisted training will benefit my motivation and comprehension of preview training materials more than traditional training approaches. | 3.59 (0.865) | 4.33 (0.856) | .002 | 3.49 (0.906) | 4.02 (0.801) | .004 | 3.78 (0.906) | .53 |
| Q9: I believe that by using ChatGPT-assisted training rather than traditional training approaches, I will be more confident in my ability to gain the knowledge and skills being taught. | 3.59 (0.999) | 4.38 (0.865) | .003 | 3.57 (0.801) | 3.86 (0.774) | .09 | 3.77 (0.895) | .33 |
| Q10: I believe that by using ChatGPT-assisted training rather than traditional training approaches, I am more confident in my ability to learn programming grammar and data analysis. | 3.54 (0.897) | 4.38 (0.865) | <.001 | 3.47 (0.856) | 3.91 (0.781) | .01 | 3.74 (0.897) | .33 |
| Q11: I believe that using ChatGPT-assisted training is more satisfying than traditional training approaches. | 3.51 (0.925) | 4.10 (0.700) | .02 | 3.51 (0.882) | 3.91 (0.718) | .02 | 3.70 (0.852) | .95 |
| Q12: I believe that the information provided by ChatGPT-assisted training meets and exceeds my expectations. | 3.63 (0.994) | 4.05 (0.805) | 0.1 | 3.64 (0.792) | 4.07 (0.704) | .008 | 3.82 (0.849) | .62 |
aThis represents a test of the difference in each item between men and women.