Table 2.

Measures of agreement between blinded and unblinded review (n=116)

	A (n)	B (n)	C (n)	D (n)	PPA*	NPA*	AR	Kappa K (SE)	95% Confidence Interval	p-value
Chest Pain	75	5	5	31	94%	86%	91%	0.80 (0.06)	0.68 – 0.92	<0.0001
Myocardial Infarction	35	5	9	67	80%	93%	88%	0.74 (0.07)	0.61 – 0.87	<0.0001
Heart Failure	36	6	2	72	95%	92%	93%	0.85 (0.05)	0.75 – 0.95	<0.0001
Coronary Revascularization	29	3	1	18	97%	86%	92%	0.84 (0.08)	0.68 – 0.99	<0.0001
ALL OUTCOMES COMBINED	175	17	19	188	91%	91%	91%	0.82 (0.03)	0.76 – 0.88	<0.0001

A = Both reviews identified outcome present

B = Unblinded review identified outcome present and blinded review identified outcome absent.

C = Blinded review identified outcome present and unblinded review identified outcome absent.

D = Both reviews identified outcome absent

PPA: Positive Percent Agreement = [A / (A+C)] * 100 (see Table 1)

NPA: Negative Percent Agreement = [D / (B+D)] * 100 (see Table 1)

AR: Percent Agreement Rate = [(A+D) / (A+B+C+D)] * 100 (see Table 1)

SE: Standard Error of measurement

^*Blinded outcomes were used as reference