Table 1.
Modified rMETRIQ Score Descriptors for GenAI-Generated Podcast Evaluation.
| Evaluation item | Score: 0 | Score: 1 | Score: 2 | Score: 3 | |
|---|---|---|---|---|---|
| 1 | Does the podcast provide enough background information to situate the user? | No background information; difficult to understand | Some background information but insufficient or unclear | Sufficient background information provided to aid understanding | Rich, detailed background information that fully supports understanding |
| 2 | Does the podcast contain an appropriate amount of information for its length? | Insufficient information | Too much or unnecessary information; inappropriate amount | Mostly appropriate amount of information; key information included | Perfectly balanced amount of information; concise yet complete |
| 3 | Is the podcast well-produced and clearly structured? | Poor audio quality, very hard to understand | Some audio issues or unclear structure | Good audio quality, mostly clear structure | Excellent audio quality, logical, and well-structured |
| 4 | Does the podcast cite its references? | No references provided | Few or inappropriate references | Appropriate references cited | Ample and appropriate references clearly provided |
| 5 | Are the editorial and prepublication peer review processes clearly outlined? | No information on editorial/review process | Some information provided but incomplete | Mostly clear about process | Detailed and clearly described process |
| 6 | How useful is the content for clinical practice or learning? | Not useful; no valuable learning points | Slightly useful; contains a few minor learning points | Useful; contains several valuable learning points | Highly useful; contains key learning points that are essential for learners |
| 7 | How interesting and engaging is the content? | Not interesting or engaging | Somewhat interesting but not particularly engaging | Interesting and engaging for the listener | Highly interesting and engaging; likely to inspire further learning |
| Free-text comments | |||||
GenAI: generative artificial intelligence; rMETRIQ: Revised Medical Education Translational Resources: Impact and Quality.