Table 2.

Interrater Reliability for N = 18 Calls

Category	Data
Gender	Percent Agreement: 100
Call content	Percent Agreement: 61–94
Current suicidal ideation	Percent Agreement: 80
Past suicidal ideation	Percent Agreement: 89
Past suicide attempt	Percent Agreement: 94
Counselor response	Intraclass correlations (ICCs): Discussed feelings = 0.00, Reflected back feelings = 0.53, Reflected back situation = 0.37, Connected with caller = 0.60, Was sensitive/receptive = 0.58, Was respectful = 0.37, Showed empathy/validation = 0.56
Caller distress—beginning	ICC: 0.92
Caller distress—end	ICC: 0.79
Overall rating: rapport	Percent Agreement: 50, or ICC = 0.49
Overall rating: collaborative problem solving	Percent Agreement: 72, or ICC = 0.46
Overall rating: referrals	Percent Agreement: 94, or ICC = 0.89
Challenging situation	ICC: 0.44
Challenging caller	ICC: 0.78
Caller satisfaction	ICC: 0.65