Table 4.
Design |
Inter-rater reliability |
Language | Conversation topic | Length of coded data | Eye tracking | |||
---|---|---|---|---|---|---|---|---|
Free flowing | Specific topic | Other | ||||||
Kendon (1967) | Quantitative | English university | o | 5–9 min | ||||
Beattie (1978) | Quantitative | 98–100% on speech; 97% on gaze. |
o | 10–15 min | ||||
Rutter et al. (1978) Study 1 | Quantitative | 90% on all measures. | English university | o | 9 min | |||
Rutter et al. (1978) Study 2 | Quantitative | 90% on all measures. | English university | o | 9 min | |||
Beattie (1979) | Quantitative | 91% on gaze. | o | |||||
Goodwin (1980) | Qualitative | English transcripts | o | 50 h (total) | ||||
Lamb (1981) | Quantitative | 90% on all measures. | o | o | ||||
Harrigan and Steffen (1983) | Quantitative | 93% on gaze. 85% on speech. |
o | 250 turns | ||||
Harrigan (1985) | Quantitative | 93% on gaze. 85% on speech. |
o | 14 min | ||||
Kalma (1992) | Quantitative | 83% on all measures. | o | 8 min | ||||
Egbert (1996) | Qualitative | German | o | 26 h (total) | ||||
Novick et al. (1996) | Quantitative | Transcripts checked, discrepancies discussed and corrected. | English | o | 20 min (total) | |||
Bavelas et al. (2002) | Quantitative | 90% on listener responses. | o | 2 min | ||||
Lerner (2003) | Qualitative | English transcripts | o | |||||
Jokinen et al. (2009) | Quantitative | 0.46 on all measures. | Japanese | o | 4–6 min | o | ||
Rossano et al. (2009) | Mixed | 0.88 on 40% inter-rated Tzeltal data | Italian Yeli Dnye Tzeltal |
o | 300 sequences | |||
Eberhard and Nicholson (2010) | Quantitative | Gaze and speech coded by two people. Any disagreements were corrected with a third person's opinion. | American English | o | ~10 min | o | ||
Cummins (2012) | Quantitative | Overall adequate agreement | Dutch | o | 15 min | |||
Jokinen et al. (2013) | Quantitative | 0.48 on gaze0.66 on speech | Japanese | o | 5 min | o | ||
Streeck (2014) | Qualitative | American English Lebanese Arabic |
o | 30 conversations | ||||
Ho et al. (2015) | Quantitative | Canadian university | o | 7 min | o | |||
Holler and Kendrick (2015) | Quantitative | 0.72 on speech Gaze—transcripts checked, discrepancies discussed and corrected. |
English | 20 min | o | |||
Park (2015) | Qualitative | University in U.S | o | 15–30 min | ||||
Brône et al. (2017) | Mixed | Transcripts coded by 3 people, checked, discrepancies discussed and corrected. | Dutch | o | o | 15–30 min | o | |
Kendrick and Holler (2017) | Mixed | English transcripts | o | 20 min | o | |||
Auer (2018) | Qualitative | German | o | 60 min | o | |||
Blythe et al. (2018) | Qualitative | 4 × Australian Aboriginal | o | 6 h 32 min (total) | ||||
Ijuin et al. (2018) | Quantitative | Japanese | o | o | 6 min | o | ||
Weiss (2018) | Qualitative | German | o | 45–60 min | o | |||
Zima et al. (2019) | Mixed | German and Dutch | o | 302 min (total) | o |
The symbol “o” represents the feature was present.