Table 5.
Correlation | Manual Transcription | ASR Transcription | Unsigned diff. | Signed diff. | |
---|---|---|---|---|---|
Repetitions | 0.77 | 0.91 (1.26) | 1.05 (1.35) | 0.50 (0.74) | −0.14 (0.88) |
Raw score | 0.88 | 10.07 (3.99) | 10.36 (4.15) | 1.46 (1.41) | −0.29 (2.01) |
Epoch 1 | 0.87 | 3.50 (1.64) | 3.36 (1.62) | 0.48 (0.71) | 0.14 (0.84) |
Epoch 2 | 0.85 | 2.12 (1.33) | 2.10 (1.32) | 0.41 (0.60) | 0.01 (0.72) |
Epoch 3 | 0.83 | 1.50 (1.20) | 1.58 (1.19) | 0.36 (0.61) | −0.08 (0.70) |
Epoch 4 | 0.79 | 1.14 (1.04) | 1.30 (1.14) | 0.37 (0.62) | −0.17 (0.71) |
Epoch 5 | 0.84 | 0.99 (0.98) | 1.07 (1.06) | 0.25 (0.53) | −0.08 (0.58) |
Epoch 6 | 0.84 | 0.79 (0.88) | 0.86 (0.93) | 0.24 (0.47) | −0.07 (0.52) |
c parameter* | 0.82 | 0.06 (0.08) | 0.05 (0.07) | 0.49 (0.71) | −0.12 (0.86) |
m parameter* | 0.78 | 12.56 (9.80) | 12.82 (10.93) | 0.39 (0.85) | 0.02 (0.94) |
Number of switches | 0.77 | 3.72 (1.66) | 3.79 (1.80) | 0.80 (0.86) | −0.08 (1.17) |
Max chain length | 0.77 | 2.91 (1.50) | 2.84 (1.48) | 0.58 (0.83) | 0.07 (1.01) |
Mean chain length | 0.57 | 1.22 (0.60) | 1.21 (0.65) | 0.37 (0.44) | 0.01 (0.58) |
M&K b (intercept) | 0.74 | 0.81 (4.83) | 1.16 (5.72) | 2.18 (3.21) | −0.35 (3.87) |
M&K s (slope) | 0.66 | 0.87 (2.09) | 0.98 (3.51) | 1.00 (2.44) | −0.10 (2.64) |
Speed score | 0.86 | 4.95 (2.62) | 4.41 (2.39) | 1.09 (0.94) | 0.54 (1.34) |
Speed edge | 0.80 | 3.60 (1.89) | 3.22 (1.73) | 0.90 (0.83) | 0.38 (1.16) |
Speed switch | 0.58 | 1.64 (0.79) | 1.56 (0.70) | 0.50 (0.49) | 0.08 (0.69) |
The data presented is from the test set (N=204). Pearson correlation was used and all other data is shown as mean (standard deviation). The unsigned (i.e., absolute value) and signed difference is presented using the actual data minus the estimated data, showing the tendency of estimated values to be larger than their counterparts.
We used Spearman correlation for the c and m parameters and list their median values rather than mean and standard deviation. Signed and unsigned differences were calculated using z-transformation.