Table IV.
Data Set | Between-System Agreement |
Between-Transcriber Agreement |
||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Trans. 1 | Trans. 2 | Cohen’s d |
Confidence Interval |
Effect Size | Analog | Digital | Cohen’s d |
Confidence Interval | Descriptor | |||
Lower | Upper | Lower | Upper | |||||||||
No. of transcripts | 8 | 4 | 4 | 4 | ||||||||
No. of utterances | 977 | 484 | 484 | 484 | ||||||||
No. of possible words | 2713 | 1404 | 1404 | 1404 | ||||||||
No. of words used | 1690 | 833 | 825 | 815 | ||||||||
Point-by-point Agreement (%) Vowels | ||||||||||||
Broad transcription | 90.3 (2.1)a | 94.9 (1.5) | −2.19*b | −3.94 | −.44 | Extremely Largec | 86.5 (3.5) | 85.4 (4.0) | .25 | −1.14 | 1.65 | Small |
Narrow transcription | 83.4 (3.8) | 90.9 (1.7) | −2.21* | −3.97 | −.45 | Extremely Large | 80.3 (4.8) | 78.2 (4.3) | .40 | −1.00 | 1.80 | Small |
Consonants | ||||||||||||
Broad transcription | 88.6 (3.6) | 93.0 (2.3) | −1.27 | −2.78 | .25 | Very Large | 76.1 (9.8) | 78.1 (6.5) | −.21 | −1.60 | 1.18 | Small |
Narrow transcription | 83.5 (3.2) | 88.1 (4.8) | −.98 | −2.45 | .49 | Large | 69.1 (10.6) | 71.5 (7.3) | −.23 | −1.62 | 1.16 | Small |
Standard deviations for the mean agreement percentages are enclosed in parentheses.
Significant effect sizes (p<.05) are indicated by an asterisk.
See text for key to effect size descriptors.