Fig. 3. Discovered feedback topic clusters and their associations with different aspects of behavioral change of a trainee.

a Association of discovered topics with trainee Behavior Adjustment, representing an observable adjustment made by a trainee that corresponds directly with the preceding feedback. b Association of discovered topics with trainee Verbal Acknowledgment representing audible reaction from the trainee confirming that they have heard the feedback. The strength of association was quantified as the Rate Ratio (RR) calculated as the rate of behavioral adjustment when feedback on a given topic was present over the rate when it was absent. The more the mean RR for a topic is to the right, the stronger the positive association. Whereas RR closer to the left denotes a negative association. We can see that some high-urgency feedback such as “Handling Bleeding’ is much more likely to result in immediate behavior adjustment and less likely to lead to verbal acknowledgment (i.e., trainee just saying he/she understood the feedback). At the same time, intuitively, “Trainer’s Queries” are much more likely to be met with just a verbal response from a trainee rather than a behavior change. We note that some of the topic titles were shortened for display purposes.