Table 9.

Examples of measures to assess “Diagnostic thinking efficacy” and “Therapeutic efficacy”

Level 3 Diagnostic thinking efficacy	Level 4 Therapeutic efficacy
The change between the raters’ pre-test diagnosis (or differential diagnosis) and post-test diagnosis (or differential diagnosis)	The change between the raters’ pre-test management strategy and post-test management strategy
The change in the raters’ estimate of the probability of their diagnosis being true, pre-test and post-test	The change in the raters’ judgement of the helpfulness of the index test in planning management
The change in the proportion of cases for which the index test was perceived as “helpful” to diagnosis	The change in the raters’ confidence that their management strategy is appropriate, pre-test and post-test
The change in the raters’ confidence that their diagnoses are true, pre-test and post-test	The number and proportion of times a procedure was changed because of information from the index test