Table 3.

Agreement between administrative (ICD-9) diagnosis codes and manual chart review^a

Comorbidity	Prevalence (Chart Review)	Prevalence (EHR)	Sensitivitya	Specificitya	Kappa Statistic	p-value ‡
Cerebrovascular disease	10%	8%	100%	98%	0.88	< 0.001
Congestive heart failure	14%	16%	50%	93%	0.45	0.001
Coronary artery disease	18%	22%	82%	100%	0.88	< 0.001
Diabetes mellitus	44%	42%	95%	93%	0.88	< 0.001
Hypertension	78%	86%	91%	100%	0.73	< 0.001

^aCalculated for ICD-9 diagnosis of each condition compared to chart review (including clinical notes, ICD-9 diagnoses, laboratory results etc.)

^‡p-values are calculated from Cohen’s Kappa test statistic as an index of interrater agreement between 2 raters on categorical data