Table III.
Between-session and between-system agreement in glossing using analog and digital systems.
| Between-Session Agreement |
Between-System Agreement |
|||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Transcriber 1 |
Transcriber 2 |
Transcriber 1 |
Transcriber 2 |
|||||||||||||||||||||
| Variable | % Agree. |
T1 | T2 | db | Confidence Interval |
% Agree. |
T1 | T2 | d | Confidence Interval |
% Agree. |
Ac | D | d | Confidence Interval |
% Agree. |
A | D | d | Confidence Interval |
||||
| Lower | Upper | Lower | Upper | Lower | Upper | Lower | Upper | |||||||||||||||||
| Total No. of Utterancesa | 977 | 1000 | −.10* | −.19 | −.01 | 480 | 476 | .03 | −.10 | .15 | 979 | 998 | −.08 | −.17 | .01 | 482 | 474 | .05 | −.07 | .18 | ||||
| M | 122.1 | 125.0 | 120.0 | 119.0 | 122.4 | 124.8 | 120.5 | 118.5 | ||||||||||||||||
| SD | 27.2 | 28.6 | 35.7 | 35.6 | 27.2 | 28.7 | 36.4 | 34.9 | ||||||||||||||||
| Total No. of Words | 2713 | 2711 | .00 | −.05 | .06 | 1415 | 1386 | .06 | −.01 | .13 | 2696 | 2728 | −.05 | −.10 | .01 | 1398 | 1403 | −.01 | −.08 | .06 | ||||
| M | 339.1 | 338.9 | 353.8 | 346.5 | 337.0 | 341.0 | 349.5 | 350.8 | ||||||||||||||||
| SD | 79.9 | 84.2 | 118.1 | 115.8 | 80.3 | 83.7 | 112.3 | 121.5 | ||||||||||||||||
| No. of Non-Questionables | 79.3 | 1748 | 1858 | −.29* | −.36 | −.23 | 84.8 | 1075 | 1067 | .02 | −.07 | .10 | 88.4 | 1770 | 1836 | −.17* | −.24 | −.11 | 86.4 | 1048 | 1094 | −.11* | −.20 | −.03 |
| M | 218.5 | 232.3 | 268.8 | 266.8 | 221.3 | 229.5 | 262.0 | 273.5 | ||||||||||||||||
| SD | 39.7 | 49.6 | 100.8 | 94.0 | 40.6 | 49.6 | 94.2 | 100.1 | ||||||||||||||||
| % of Total Words | 64.4 | 68.5 | 76.0 | 77.0 | 65.7 | 67.3 | 75.0 | 78.0 | ||||||||||||||||
| No. of Disregards | 61.3 | 574 | 497 | .57* | .44 | .69 | 53.0 | 167 | 124 | .36* | .13 | .60 | 63.8 | 541 | 530 | .07 | −.05 | .19 | 60.1 | 153 | 138 | .12 | −.11 | .35 |
| M | 71.8 | 62.1 | 41.8 | 31.0 | 67.6 | 66.3 | 38.3 | 34.5 | ||||||||||||||||
| SD | 15.8 | 17.1 | 26.2 | 31.4 | 15.2 | 19.1 | 29.7 | 29.2 | ||||||||||||||||
| % of Total Words | 21.2 | 18.3 | 11.8 | 8.9 | 20.1 | 19.4 | 10.9 | 9.8 | ||||||||||||||||
| No. of Questionables | 21.5 | 68 | 90 | −.38* | −.70 | −.06 | – | 4 | 0 | – | – | – | 19.4 | 69 | 89 | −.34* | −.66 | −.02 | – | 0 | 4 | – | – | – |
| M | 8.5 | 11.3 | 1.0 | .0 | 8.6 | 11.1 | .0 | 1.0 | ||||||||||||||||
| SD | 5.0 | 8.2 | 2.0 | .0 | 4.9 | 8.3 | .0 | 2.0 | ||||||||||||||||
| % of Total Words | 2.5 | 3.3 | .3 | 0 | 2.6 | 3.3 | 0 | .3 | ||||||||||||||||
| No. Unintelligibles | 57.1 | 323 | 266 | .13 | −.03 | .30 | 169 | 195 | −.10 | −.31 | .11 | 60.1 | 316 | 273 | .10 | −.06 | .26 | 58.8 | 197 | 167 | .12 | −.09 | .32 | |
| M | 40.4 | 33.3 | 42.3 | 48.8 | 39.5 | 34.1 | 49.3 | 41.8 | ||||||||||||||||
| SD | 55.7 | 43.9 | 54.0 | 68.6 | 55.9 | 43.8 | 68.0 | 54.7 | ||||||||||||||||
| % of Total Words | 11.9 | 9.8 | 11.9 | 14.1 | 11.7 | 10 | 14.1 | 11.9 | ||||||||||||||||
a
The glossing numbers are from the unedited versions of the glosses. The agreement percentages are based on the gloss agreement analyses generated from edited versions of the transcripts, with the number of edits (i.e., additional disagreements) added to the denominators.
b
Significant Cohen’s d effect sizes (p<.05) are indicated by an asterisk; see text for key to effect size descriptors.
c
A = Analog; D = Digital.