Abstract
Studies in applied behavior analysis have used two expressions of reliability for human observations: percentage agreement (including percentage occurrence and percentage nonoccurrence agreement) and correlational techniques (including the phi coefficient). The formal relationship between these two expressions is demonstrated, and a table for converting percentage agreement to phi, or vice-versa, is presented. It is suggested that both expressions be reported in order to communicate reliability unambiguously and to facilitate comparison of the reliabilities from different studies.
Keywords: reliability, observer agreement, phi, percentage agreement, methodology
Full text
PDF
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Hartmann D. P. Considerations in the choice of interobserver reliability estimates. J Appl Behav Anal. 1977 Spring;10(1):103–116. doi: 10.1901/jaba.1977.10-103. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kelly M. B. A review of the observational data-collection and reliability procedures reported in The Journal of Applied Behavior Analysis. J Appl Behav Anal. 1977 Spring;10(1):97–101. doi: 10.1901/jaba.1977.10-97. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kratochwill T. R., Wetzel R. J. Observer agreement, credibility, and judgment: some considerations in presenting observer agreement data. J Appl Behav Anal. 1977 Spring;10(1):133–139. doi: 10.1901/jaba.1977.10-133. [DOI] [PMC free article] [PubMed] [Google Scholar]