Table 4.

Interrater reliability among four otolaryngologists based on Cohen kappa in Top-1 and Top-2.

Diagnoses		Cohen kappa
Top-1
	Overall	0.71
	External ear disease	1.00
	Postoperative complication	1.00
	Cerumen impaction	1.00
	Superior semicircular canal dehiscence syndrome	1.00
	Benign paroxysmal positional vertigo	0.82
	Tinnitus	0.82
	Otitis media with effusion	0.82
	Eustachian tube dysfunction	0.82
	Facial palsy	0.82
	Chronic otitis media	0.69
	Acute otitis media	0.37
	Hearing loss	0.19
	Meniere disease	0.18
	Normal findings	0.18
Top-2
	Overall	0.91
	Middle ear tumor	1.00
	Benign paroxysmal positional vertigo	1.00
	Vestibular neuritis	1.00
	Tinnitus	1.00
	Meniere disease	1.00
	External ear disease	1.00
	Postoperative complication	1.00
	Cerumen impaction	1.00
	Superior semicircular canal dehiscence syndrome	1.00
	Facial palsy	0.94
	Chronic otitis media	0.92
	Hearing loss	0.92
	Eustachian tube dysfunction	0.88
	Otitis media with effusion	0.82
	Schwannoma	0.74
	Acute otitis media	0.50
	Normal findings	0.18