Table 3.
The time and cost spent on collecting the data using “full manual,” “LLM-assisted manual,” and “LLM” methods
| Full manual | LLM-assisted manual | LLM | ||||
|---|---|---|---|---|---|---|
| 340 patients | All patients (extrapolated) | 340 patients | All patients (extrapolated) | 340 patients | All patients | |
| Time spent (hr) | ||||||
| For data collection | 14.3 | 122.6 | 8.8 | 75.4 | - | - |
| For prompt design and trimming | - | - | 4.0 | 4.0 | 4.0 | 4.0 |
| Total | 14.3 | 122.6 | 12.8 | 79.4 | 4.0 | 4.0 |
| Time saved compared to “full manual” | - | - | 1.5 | 43.2 | 9.3 | 118.6 |
| Estimated cost (US dollar) | ||||||
| Manual data collection wage cost | 106.1 | 909.3 | 65.6 | 558 | - | - |
| Prompt design and trimming wage cost | - | - | 29.6 | 29.6 | 29.6 | 29.6 |
| GPT API usage fee | - | - | 7.7 | 65.8 | 7.7 | 65.8 |
| Total | 106.1 | 909.3 | 102.9 | 653.4 | 37.3 | 95.4 |
| Cost saved compared to “full manual” | - | - | 3.2 | 255.9 | 68.8 | 813.9 |
API, application programming interface; LLM, large language model; Bold, total time and cost.