TABLE 2.

Comparisons of MDS clinician raters versus research findings

Panel A: resident capacity for self-report (N = 227)			Researcher			κ = 0.52, p = .062; moderate agreement between the groups
			No self-report	Self-report	Total
MDS clinician ratings	No self-report	Count	43	16	59
		Row %	72.88	27.12	100.00
	Self-report	Count	29	139	168
		Row %	17.26	82.74	100.00
	Total	Count	72	155	227
		Row %	31.72	68.28	100.00
Panel B: residents with suicidal ideation (N = 148)a,b			Researcher			κ = 0.10, p = .060; poor agreement between the groups
			No suicidal ideation	Suicidal ideation	Total
MDS clinician raters	No suicidal ideation	Count	132	14	146	Sensitivity	0.07
		Row %	90.41	9.59	100.00	Specificity	0.99
		Column %	99.25	93.33	98.65	PPV	0.50
	Suicidal ideation	Count	1	1	2	NPV	0.90
		Row %	50.00	50.00	100.00	OCC	0.90
		Column %	0.75	6.67	1.35	PEA	0.89
	Total	Count	133	15	148	OR (95% CI)	9.43 (0.56, 159.14)
		Row %	89.86	10.14	100.00	Kappa	0.10
		Column %	100.00	100.00	100.00	Maximum Kappa	0.22
Panel C: residents with at least moderate depression (score of 10+) (N = 150)a			Researcher			κ = −0.02, p = .793; no agreement beyond that predicted by chance
			Score of less than 10	Score of 10 or greater	Total
MDS clinician raters	Score of less than 10	Count	122	18	140	Sensitivity	0.05
		Row %	87.14	12.86	100.00	Specificity	0.93
		Column %	93.13	94.74	93.33	PPV	0.10
	Score of 10 or greater	Count	9	1	10	NPV	0.87
		Row %	90.00	10.00	100.00	OCC	0.82
		Column %	6.87	5.26	6.67	PEA	0.82
	Total	Count	131	19	150	OR (95% CI)	0.75 (0.09, 6.30)
		Row %	87.33	12.67	100.00	Kappa	−0.02
		Column %	100.00	100.00	100.00	Maximum Kappa	0.67

MDS, Minimum Data Set; PPV, positive predictive value; NPV, negative predictive value; OCC, overall correct classification (percent agreement); PEA, percent expected agreement; OR, odds ratio.

^aResearcher is treated as the gold standard.

^bItem is “Thoughts that you would be better off dead or of hurting yourself in some way?”.