Table 3. Comparison of inter-rater reliability for video and audio thin slice ratings*.
Video thin slices | Audio thin slices | |||||||
---|---|---|---|---|---|---|---|---|
Variable | ICC | 95% CI | Reliability | 95% CI | ICC | 95% CI | Reliability | 95% CI |
Patient Affect | ||||||||
Warm/ Friendly | 0.47 | 0.41, 0.52 | 0.78 | 0.74, 0.81 | 0.38 | 0.33, 0.44 | 0.71 | 0.66, 0.76 |
Tense/ Anxious | 0.24 | 0.18, 0.29 | 0.55 | 0.47, 0.63 | 0.26 | 0.20, 0.32 | 0.58 | 0.50, 0.65 |
Engaged / Attentive | 0.44 | 0.38, 0.50 | 0.76 | 0.71, 0.80 | 0.45 | 0.40, 0.51 | 0.77 | 0.72, 0.81 |
Disagreeable/ Antagonistic | 0.48 | 0.42, 0.53 | 0.78 | 0.74, 0.82 | 0.36 | 0.30, 0.42 | 0.69 | 0.64, 0.74 |
Upset/ Distressed | 0.42 | 0.37, 0.48 | 0.74 | 0.70, 0.79 | 0.46 | 0.40, 0.51 | 0.77 | 0.73, 0.81 |
Sad / Depressed | 0.46 | 0.41, 0.52 | 0.77 | 0.73, 0.81 | 0.35 | 0.29, 0.41 | 0.68 | 0.62, 0.74 |
Physician Affect | ||||||||
Warm/ Friendly | 0.38 | 0.33, 0.44 | 0.71 | 0.66, 0.76 | 0.35 | 0.30, 0.41 | 0.69 | 0.63, 0.74 |
Tense/ Anxious | 0.16 | 0.11, 0.22 | 0.44 | 0.33, 0.53 | 0.06 | 0.02, 0.11 | 0.21 | 0.06, 0.33 |
Engaged/ Attentive | 0.38 | 0.32, 0.42 | 0.71 | 0.66, 0.76 | 0.37 | 0.31, 0.43 | 0.70 | 0.65, 0.75 |
Disagreeable / Antagonistic | 0.35 | 0.29, 0.41 | 0.68 | 0.62, 0.73 | 0.32 | 0.26, 0.38 | 0.65 | 0.59, 0.71 |
Hesitant/ Uncomfortable | 0.34 | 0.28, 0.40 | 0.67 | 0.61, 0.73 | 0.22 | 0.17, 0.28 | 0.54 | 0.45, 0.61 |
Rushed/ Hurried | 0.34 | 0.29, 0.40 | 0.68 | 0.62, 0.73 | 0.18 | 0.13, 0.24 | 0.47 | 0.37, 0.56 |
Patient-Physician Rapport | ||||||||
Rapport | 0.42 | 0.35, 0.48 | 0.68 | 0.62, 0.74 | 0.34 | 0.28, 0.41 | 0.61 | 0.53, 0.68 |
Liking | 0.42 | 0.35, 0.58 | 0.68 | 0.62, 0.74 | 0.36 | 0.30, 0.43 | 0.63 | 0.56, 0.69 |
Attention | 0.42 | 0.35, 0.48 | 0.68 | 0.62, 0.73 | 0.28 | 0.22, 0.35 | 0.54 | 0.45, 0.62 |
Coordination | 0.39 | 0.32, 0.46 | 0.66 | 0.59, 0.72 | 0.31 | 0.24, 0.38 | 0.57 | 0.49, 0.64 |
Trust | 0.43 | 0.36, 0.49 | 0.69 | 0.63, 0.74 | 0.33 | 0.26, 0.39 | 0.59 | 0.51, 0.66 |
ICC refers to a single rating; reliability refers to the mean across raters calculated using the Spearman-Brown formula.