. Author manuscript; available in PMC: 2011 Sep 18.

Published in final edited form as: EJNMMI Res. 2011 Jun 20;1(5):1–8. doi: 10.1186/2191-219X-1-5

Table 3.

Pairwise agreement within experts and between experts and RENEX

	Log-linear model coefficients
	Between experts			RENEX and expert
	E₁E₂ [δ_m1, (SE)]	E₁E₃ [δ_m2, (SE)]	E₂E₃ [δ_m3, (SE)]	R E₁ [θ_m1, (SE)]	R E₂ [θ_m2, (SE)]	R E₃ [θ_m3, (SE)]
Non-obstructed	1.58^* (0.42)	0.36 (0.40)	0.91 (0.46)	0.26 (0.40)	1.08^* (0.41)	0.84^* (0.32)
Equivocal	−0.12 (0.40)	0.89 (0.37)	−0.58 (0.44)	−0.06 (0.37)	−0.28 (0.39)	0.47 (0.33)
Obstructed	0.78 (0.46)	−0.07 (0.43)	1.47^* (0.45)	0.48 (0.43)	1.08 (0.44)	0.41 (0.38)
	p values for tests of hypothesis Among experts		RENEX and expert	Experts vs. RENEX
	H₀: δ_m1 = δ_m2 = δ_m3 ^a		H₀: θ_m1 = θ_m2 = θ_m3 ^b	H₀: δ_m1 + δ_m2 + δ_m3 = θ_m1 + θ_m2 + θ_m3 ^c
Non-obstructed	0.15		0.47	0.41
Equivocal	0.08		0.34	0.95
Obstructed	0.11		0.58	0.81

Significant positive pairwise agreement at α = 0.01.

Hypothesis that the overall pairwise agreement among experts is the same. The δs reflect the strength of the beyond-chance agreement between two raters within each specific category.

Hypothesis that the overall pairwise agreement between RENEX and each expert is the same. The θs reflect the strength of the beyond-chance agreement between RENEX and an expert within each specific category.

Hypothesis that the overall pairwise agreement among experts is the same as the overall pairwise agreement between each expert and RENEX.