Skip to main content
. 2018 Feb 6;19:34. doi: 10.1186/s12859-018-2045-1

Table 15.

Inter-annotator agreement broken down by question types and corresponding triggers

Category Trigger Type Trigger Type
CHQA-email CHQA-web
General question types
comparison 0.28 0.43 0.66 0.77
information 0.37 0.51 0.65 0.75
time - - 0.47 0.65
other_question 0.23 0.39 0.00 0.00
Problem question types
cause 0.60 0.64 0.63 0.76
complication 0.17 0.21 0.58 0.64
diagnose_me - - 0.72 0.82
diagnosis 0.30 0.48 0.51 0.72
effect (association) 0.35 0.45 0.17 0.17
frequency 0.20 0.30 - -
inheritance 0.30 0.46 - -
lifestyle_diet 0.02 0.25 0.32 0.37
location 0.20 0.20 0.60 0.85
person_organization 0.43 0.63 0.18 0.63
prevention 0.44 0.51 0.50 0.50
prognosis 0.25 0.49 0.41 0.77
support_group 0.00 0.00 - -
susceptibility 0.26 0.34 0.57 0.73
symptom 0.26 0.45 0.53 0.65
treatment 0.52 0.75 0.76 0.86
Intervention question types
action 0.03 0.19 0.57 0.60
alternative 0.18 0.22 - -
contraindication 0.10 0.25 0.57 0.67
cost 0.40 0.40 1.00 1.00
dosage 0.23 0.37 - -
indication 0.15 0.29 0.48 0.75
ingredient 0.36 0.83 0.50 0.50
interaction 0.20 0.73 0.57 0.78
long_term_effect 0.22 0.30 - -
overdose 0.00 0.33 - -
side_effect 0.31 0.39 - -
storage_disposal 0.19 0.35 - -
tapering 0.13 0.36 - -
usage 0.08 0.40 0.62 0.72
drug_question 0.14 0.28 - -