Table 2.
Definitions and Inter-Rater Agreement for Observation Codes
| Code | Definitions | % Agree |
|---|---|---|
| Staff Behavior | ||
| Actively connecting with students | “Checks in” w/student(s); greeting, statement, question, physical contact, gesture; not a directive | 77% |
| Approval | Verbal praise or recognition of student(s) behavior; approving physical contact or gestures | 91% |
| Criticism | Verbal criticism, gestural, or physical contact of disapproval of student behavior; threats of punishment | 97% |
| Tangible reinforce | Giving tangible reinforcement for student behavior (points, objects, or privileges) | 99% |
| Tangible punitive consequences | Tangible punitive consequences for student behavior (removal points or privileges, remove from activity, discipline referral) | 97% |
| Average inter-rater reliability for staff behavior | 92% | |
| Student Behavior | ||
| Noncompliance | Student does not follow staff directive for a behavior change (to start or stop behavior within 5 seconds). | 96% |
| Potentially dangerous behavior | Engaged in behavior that is potentially dangerous to self or others, not safe, misuse of school equipment | 74% |
| Verbal aggression to peer | Verbal disapproval or critical judgment of peer that is present (name calling, swearing at a peer, threats, mean spirited teasing, angry yelling at peer, exclusion of peer) | 82% |
| Physical aggression to peer | Aversive physical contact (e.g., hits, kicks, pushes, restrains, spits on) a peer | 75% |
| Average inter-rater reliability for student behavior | 82% | |