Table 4.
Inter-observer reliabilities for each outcome measurement over 5 min intervals [median (range)]
| Inter-observer reliabilities (using ICCs) | ||||
|---|---|---|---|---|
| Baselinea | Post-testa | Follow-upa | Ongoingb | |
| Structured observations of teacher behaviour to the whole class | ||||
| Teacher positives | 0.97 (0.94–0.99) | 0.99 (0.99–1.00) | 0.96 (0.90–0.98) | 0.91 (0.79–0.95) |
| Teacher negatives | 0.94 (0.90–0.97) | 0.93 (0.83–0.97) | 0.92 (0.84–0.95) | 0.93 (0.80–0.96) |
| Structured observations of teacher behaviour to target children | ||||
| Teacher positives | 0.90 (0.86–0.94) | 0.93 (0.86–0.97) | – | 0.92 (0.83–0.98) |
| Teacher negatives | 0.86 (0.78–1.0) | 0.86 (0.72–1.0) | – | 0.91 (0.86–0.96) |
| Rating Scales of teacher behaviour to the whole class | ||||
| Teacher warmth | 0.84 (0.65–0.93) | 0.93 (0.86–0.97) | 0.88 (0.82–0.92) | 0.87 (0.72–0.94) |
| Opportunities to share/help | 0.96 (0.92–0.99) | 0.93 (0.82–0.97) | 0.86 (0.80–0.98) | 0.90 (0.82–0.95) |
| Rating Scales of class-wide child behaviour | ||||
| Appropriate behaviour | 0.87 (0.73–0.95) | 0.86 (0.82–0.92) | 0.88 (0.79–0.95) | 0.86 (0.82–0.92) |
| Interest and enthusiasm | 0.81 (0.60–0.92) | 0.90 (0.79–0.96) | 0.85 (0.71–0.92) | 0.86 (0.80–0.92) |
ICC, intra-class correlation coefficient.
a
n = 20 observations prior to starting data collection between trainer and each observer and a minimum of 15 between each observer and other observers.
b
15% of all observations between master coder and each observer and a minimum of 10 between each observer and other observers during each data collection period.