Table 3.
Percentages of statements in verbal protocols for experienced raters (Exp) and non-experienced raters (Non-Exp)
| Variable | Overall (VP1 + VP2 + VP3 + VP4) | VP1 | VP2 | VP3 | VP4 | |||||
|---|---|---|---|---|---|---|---|---|---|---|
| Exp | Non-Exp | Exp | Non-Exp | Exp | Non-Exp | Exp | Non-Exp | Exp | Non-Exp | |
| Mdn (IQR) | Mdn (IQR) | Mdn (IQR) | Mdn (IQR) | Mdn (IQR) | Mdn (IQR) | Mdn (IQR) | Mdn (IQR) | Mdn (IQR) | Mdn (IQR) | |
| Descriptives | 19.8 (13.2) | 25.3 (11.0)a | 19.8 (20.1) | 26.1 (12.8) | 10.8 (18.2) | 10.7 (18,6) | 16.9 (16.3) | 29.4 (13.3)a | 18.2 (16.5) | 20.4 (10.6) |
| Inferences | 19.0 (7.9) | 14.7 (5.1)a | 38.9 (22.9) | 37.5 (21.2) | 14.8 (25.6) | 20.0 (25,1) | 14.5 (9.8) | 6.8 (9.2)a | 13.5 (14.0) | 5.6 (4.6)a |
| Evaluations | 24.4 (10.4) | 24.9 (4.7) | 7.6 (16.0) | 5.4 (10.1) | 33.3 (15.1) | 18.2 (20,0)a | 24.9 (16.3) | 25.9 (12.6) | 35.9 (17.3) | 41.3 (17.3) |
| Contextual cues | 12.9 (7.7) | 10.4 (7.3) | 13.2 (7.7) | 6.1 (14.6)a | 8.1 (13.5) | .0 (13.7) | 18.3 (15.0) | 9.8 (11.1) | 10.0 (9.1) | 8.8 (8.6) |
| Self-monitoring | 20.4 (8.8) | 20.5 (10.7) | 15.2 (10.8) | 16.7 (10.6) | 27.9 (22.7) | 40.4 (35.9) | 20.2 (13.2) | 19.4 (10.4) | 17.2 (14.6) | 13.5 (13.4) |
Presented are the median en inter-quartile range (in parentheses)
VP1 verbal protocol at T1, initial representation of student behavior; VP2 verbal protocol at T1, while filling out the one-dimensional rating scale (overall judgment); VP3 verbal protocol at T2, after viewing entire DVD, overall judgment of student performance while filling out one-dimensional rating scale; VP4 verbal protocol while filling out 6-dimensional rating scale
aIndicates significant differences between experienced and non-experienced raters [Mann–Whitney U test, p < .05]