Table 5.
|
Consensus competency correspondence based on review of … |
||
---|---|---|---|
Scenario only | Scenario±Responses±Key | Kappa | |
Leading others | 11 | 9 | .863 |
Mentoring others | 6 | 7 | .907 |
Integrity/Professionalism | 7 | 6 | .720 |
Communication | 6 | 6 | .602 |
Decision-Making/Managing resources | 4 | 7 | .684 |
Leading innovation | 3 | 2 | .786 |
Total | 37 scenarios (across SJT versions T1 and T2) |
Scenario-only categorization is based on the consensus across three Ph.D. personnel research psychologists (identification of which of the six target competencies each SJT scenario most closely corresponded to). A second independent group of three industrial/organizational psychologists (one Ph.D. and two masters-level graduates) completed the same categorization task based on review of each scenario and the corresponding response options and key. Cohen’s kappa values indicate the extent of agreement between these two groups of raters.