Table 1.

Comparison of unrestricted manual electronic record review for evidence of problematic opioid use to reviews restricted to clinical notes or clinical communications

All records	Review concordance (percent)	κ (95 percent CI)
Comparison notes to clinical communication	74	0.413 (0.195–0.630)
Comparison Reviewers 1 and 2	74	0.418 (0.206–0.630)
Comparison notes to full record review	78	0.619 (0.433–0.805)
Comparison clinical communication to full record review	60	0.290 (0.104–0.478)

Note: Clinical Communication represents record review restricted to clinical communications. Notes represent record review restricted to clinical notes. Full record review represents all records reviewed, including billing codes and problem lists. κ represents Cohen’s κ.