Table 1.
Readability and health literacy measures of American Academy of Dermatology Association (AAD) text, ChatGPT output, ChatGPT output with 1 prompt, and ChatGPT output with 2 prompts.
|
|
AAD | ChatGPT | ChatGPT with 1 prompt | ChatGPT with 2 prompts | |
| Sunscreen FAQs | |||||
|
|
Flesch Reading Ease score | 60.9 (standard/average) | 60.5 (standard/average) | 69.4 (standard/average) | 80.2 (easy) |
|
|
Gunning Fog | 11.1 (hard) | 11.7 (hard) | 8.0 (fairly easy) | 6.2 (fairly easy) |
|
|
Flesch-Kincaid Grade Level | 8.9 (9th grade) | 9.1 (9th grade) | 5.6 (6th grade) | 3.8 (4th grade) |
|
|
Coleman-Liau Index | 10.0 (10th grade) | 10.0 (10th grade) | 10.0 (10th grade) | 8.0 (8th grade) |
|
|
SMOGa Index | 8.2 (8th grade) | 8.6 (9th grade) | 6.0 (6th grade) | 4.9 (5th grade) |
|
|
Automated Readability Index | 9.4 (9th grade) | 9.4 (9th grade) | 4.6 (5th grade) | 2.5 (3rd grade) |
|
|
Linsear Write Formula | 9.3 (9th grade) | 10.8 (11th grade) | 4.0 (4th grade) | 2.8 (3rd grade) |
|
|
Average readabilityb | 9.2 (9th grade) | 9.6 (10th grade) | 6.0 (6th grade) | 4.4 (4th grade) |
| Melanoma FAQs | |||||
|
|
Flesch Reading Ease score | 56.2 (fairly difficult) | 46.5 (difficult) | 58.9 (fairly difficult) | 59.3 (fairly difficult) |
|
|
Gunning Fog | 12.5 (hard to read) | 13.7 (hard to read) | 11.0 (hard to read) | 10.9 (hard to read) |
|
|
Flesch-Kincaid Grade Level | 9.5 (10th grade) | 10.5 (11th grade) | 8.0 (8th grade) | 7.9 (8th grade) |
|
|
Coleman-Liau Index | 9.0 (9th grade) | 12.0 (12th grade) | 10.0 (10th grade) | 8.0 (8th grade) |
|
|
SMOG Index | 9.4 (9th grade) | 10.1 (10th grade) | 8.3 (8th grade) | 8.2 (8th grade) |
|
|
Automated Readability Index | 8.4 (8th grade) | 9.7 (10th grade) | 6.9 (7th grade) | 6.3 (6th grade) |
|
|
Linsear Write Formula | 10.8 (11th grade) | 9.5 (10th grade) | 7.0 (7th grade) | 6.8 (7th grade) |
|
|
Average readability | 9.4 (9th grade) | 10.4 (10th grade) | 8.0 (8th grade) | 7.4 (7th grade) |
| Accuracy scorec, mean (SD) | 2.82 (0.25) | 2.89 (0.19) | 2.63 (0.41) | 2.62 (0.37) | |
aSMOG: Simple Measure of Gobbledygook.
bThe average readability score was computed by averaging the tests with grade levels as outputs: Flesch-Kincaid Grade Level, Coleman-Liau Index, SMOG Index, Automated Readability Index, and Linsear Write Formula.
cThe accuracy score represents the mean score of 3 dermatology residents who assessed the educational materials using a numeric scale: 1 (not accurate), 2 (somewhat accurate), and 3 (accurate).