Skip to main content
. Author manuscript; available in PMC: 2014 Dec 1.
Published in final edited form as: J Biomed Inform. 2013 Aug 23;46(6):10.1016/j.jbi.2013.08.001. doi: 10.1016/j.jbi.2013.08.001

Table 3.

Inter-rater Reliability by Health-ITUEM Concept

Exemplar 1 Exemplar 2 IRR
IRR IRR Total
Flexibility/Customizability 100% 59% 66%
Performance Speed 82% 88% 87%
Competency 83% 100% 95%
Learnability 100% 75% 88%
Completeness 87% 100% 93%
Memorability 100% 100% 100%
Information Needs 100% 86% 91%
Other Outcomes 97% 91% 93%
Error Prevention 100% 100% 100%
Total 94% 89% 90%