Table 4.
Readability of ChatGPT responses to definition-based questions on gastrointestinal conditions and treatments
| Areas and questions | Readability scores | ||
| Flesch Reading Easea | Flesch-Kincaid Grade Levelb | SMOGc | |
| General gastrointestinal | |||
| Acid reflux | 36.6 (difficult) | 12.1 (college) | 13.6 |
| Acid reflux treatment | 31.2 (difficult) | 13.5 (college) | 14.6 |
| Celiac disease | 22.9 (very difficult) | 15.2 (postgrad) | 16.9 |
| Celiac disease treatment | 29.2 (very difficult) | 14.1 (college) | 15.1 |
| Dietary recommendations | 37.6 (difficult) | 12.2 (college) | 13.8 |
| Diverticulitis | 19.5 (very difficult) | 15.9 (postgrad) | 16.4 |
| Diverticulitis treatment | 21.5 (very difficult) | 15.2 (postgrad) | 16.7 |
| Hepatitis | 32.4 (difficult) | 13.6 (college) | 15.8 |
| Hepatitis treatment | 28.2 (very difficult) | 13.0 (college) | 15.5 |
| IBD vs IBS | 26.4 (very difficult) | 14.0 (college) | 16.3 |
| Colonoscopy | |||
| What is a colonoscopy? | 27.5 (very difficult) | 15.7 (postgrad) | 17.3 |
| Colonoscopy prep | 42.5 (difficult) | 12.4 (college) | 14.9 |
| Age for colonoscopy | 30.2 (difficult) | 14.8 (college) | 16.7 |
| Overall mean (SD) | 29.7 (6.6) (very difficult) | 14.0 (1.3) (college) | 15.7 (1.2) |
ChatGPT, Chat Generative Pretrained Transformer; Comp, comprehensiveness; IBD, inflammatory bowel disease; IBS, irritable bowel syndrome; SMOG, Simple Measure of Gobbledygook Index.
a
Flesch Reading Ease score ranges from 1 to 100 (higher score is easier to read).
b
Flesch-Kincaid Grade Level ranges from 1 to 18 (lower grade is easier to read).
c
SMOG formula estimates reading grade level (lower grade is easier to read).