Abstract
Two sources of variability must each be considered when examining change in level between two sets of data obtained by human observers; namely, variance within data sets (phases) and variability attributed to each data point (reliability). Birkimer and Brown (1979a, 1979b) have suggested that both chance levels and disagreement bands be considered in examining observer reliability and have made both methods more accessible to researchers. By clarifying and extending Birkimer and Brown's papers, a system is developed using observer agreement to determine the data point variability and thus to check the adequacy of obtained data within the experimental context.
Keywords: interobserver agreement, chance agreement, chance reliability, percentage agreement, reliability, observational data, observational technology
Full text
PDF
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Yelton A. R., Wildman B. G., Erickson M. T. A probability-based formula for calculating interobserver agreement. J Appl Behav Anal. 1977 Spring;10(1):127–131. doi: 10.1901/jaba.1977.10-127. [DOI] [PMC free article] [PubMed] [Google Scholar]