Abstract
Estimates of observer agreement are necessary to assess the acceptability of interval data. A common method for assessing observer agreement, per cent agreement, includes several major weaknesses and varies as a function of the frequency of behavior recorded and the inclusion or exclusion of agreements on nonoccurrences. Also, agreements that might be expected to occur by chance are not taken into account. An alternative method for assessing observer agreement that determines the exact probability that the obtained number of agreements or better would have occurred by chance is presented and explained. Agreements on both occurrences and nonoccurrences of behavior are considered in the calculation of this probability.
Keywords: observer agreement, probability-based formula, recording and measurement techniques, time sampling, reliability
Full text
PDF![127](https://cdn.ncbi.nlm.nih.gov/pmc/blobs/da99/1311159/30d6871da56c/jaba00112-0129.png)
![128](https://cdn.ncbi.nlm.nih.gov/pmc/blobs/da99/1311159/5c1761edacc7/jaba00112-0130.png)
![129](https://cdn.ncbi.nlm.nih.gov/pmc/blobs/da99/1311159/afcb95dafb4d/jaba00112-0131.png)
![130](https://cdn.ncbi.nlm.nih.gov/pmc/blobs/da99/1311159/b79e780e271e/jaba00112-0132.png)
![131](https://cdn.ncbi.nlm.nih.gov/pmc/blobs/da99/1311159/c2cc53b272c2/jaba00112-0133.png)
Selected References
These references are in PubMed. This may not be the complete list of references from this article.
- Werry J. S., Quay H. C. Observing the classroom behavior of elementary school children. Except Child. 1969 Feb;35(6):461–470. [PubMed] [Google Scholar]