AC: Activities Coding	Identification of the need for increased specificity of staff and resident activities code definitions. Resulted in significant revisions of coding rules, reorganization of similar activities into a number of discrete categories (e.g., staff assisting resident; resident needs assistance) and the addition of nearby and proximal specifiers within the code names to support rater memorization and application efforts.
CR: Social Role Definitions	Identification of the need for increased specificity of the communication role definitions within the context of the GFAs. Resulted in definition modifications and the addition of a wide variety of examples.
DD: Discipline Differences	Identification of systematic differences in application of coding rules by discipline. Resulted in extensive revisions to coding rules and use of multidisciplinary rater teams going forward to assure generalizability.
ED: Emotion Definitions	Identification of the need for increased specificity of emotion definitions to increase reliability. Resulted in adding a wide variety of examples to the coding rules and specifying four kinds of expressive behaviors that could be focused upon for behavioral indications of emotional valence and intensity.
RLP: Rater Logistics/ Procedures	Identification of need for modifications of the observation protocol and of the materials used to record ratings during observation. Resulted in forms and procedures changes. For example, the data record form was modified from standard to legal sized paper to encourage more note taking thus allowing raters to double-check their codes immediately after an observation session to reduce errors and increase reliability.
RM: ROR/MOR Definitions	Identification of the need for increased specificity of Realized Opportunity for Relationship (ROR)/Missed Opportunity for Relationship (MOR) definitions within the context of Group Formal Activities. Resulted in coding rule revisions, addition of additional examples and the addition of the NOR (Neither ROR nor MOR) code to indicate those occasions in which neither MOR nor ROR were applicable.
RT: Rater Training	Identification of need for modifications of procedures and materials used to train raters. Resulted in development of supplementary rater training materials such as a rater training guide and glossary. Resulted in development of an iterative evaluation method to assess each subsequent procedure and material revision (such that the quality of rater training procedures and materials were determined based on the raters’ performance in applying coding rules, and their self-reports regarding their experiences in trying to learn the material).
	Specific training challenges that were identified and evaluated included: raters’ ability to develop an advanced understanding of the interdependence of coding rules (e.g., if Emotional Tone = x and Resident Activity = z then Staff Interaction Type cannot be = y); raters’ efforts to gain mastery of code applications across the wide variety of physical environment scenarios that can occur; raters’ efforts to gain mastery across the wide variety of events that can occur and how these events covary with the typical behaviors of residents with certain kinds of physical and cognitive abilities; and raters’ efforts to gain mastery of the typical interaction challenges staff exhibit other staff, as well as with residents of varying physical and cognitive abilities.