. Author manuscript; available in PMC: 2016 Jul 1.

Published in final edited form as: J Learn Disabil. 2013 Oct 23;48(4):433–445. doi: 10.1177/0022219413508323

Table 7.

Overall Proportion of Agreement, Kappa, and Affected-Status Agreement Statistics for Research-Based Criteria.

Method	OPA	Kappa	ASAS	Number Identified
Method	OPA	Kappa	ASAS	1 & 2	1 & Not 2	2 & Not 1	Neither 1 Nor 2
Poor NWF (1) and Poor ORF (2)	.953	.530	.552	14,267	12,091	11,152	453,383
Poor NWF (1) and ORF residuals (2)	.916	.154	.109	2,189	9,491	8,439	192,721
Poor NWF (1) and NWF residuals (2)	.947	.465	.330	5,520	6,164	5,063	196,106
Poor ORF (1) and ORF residuals (2)	.93	.317	.217	4,106	8,321	6,525	193,923
Poor ORF (1) and NWF residuals (2)	.923	.247	.171	3,358	9,065	7,223	193,194
ORF residuals (1) and NWF residuals (2)	.938	.345	.231	3,973	6,655	6,608	195,604

ASAS = affected-status agreement statistic; NWF = Nonsense Word Fluency; OPA = overall proportion of agreement; ORF = Oral Reading Fluency; RI = identified as having a reading impairment in the research; SI = school-identified LD status.