Fig 4. Scatter plots of oracle requests vs mean score across participants.

Mean score is defined as the mean of total points collected by a participant across all non-practice trials. Total Oracle Requests is the count of trials where the participant called the Oracle, across all non-practice trials. A significant positive correlation is seen indicating the relationship between correctly identifying problems where the oracle is useful, and overall performance. Correlation is significant with Pearson-r = 0.78, p < 0.0001.