Skip to main content
. Author manuscript; available in PMC: 2014 Dec 2.
Published in final edited form as: World J Surg. 2014 Aug;38(8):1984–1989. doi: 10.1007/s00268-014-2489-z

Table 3.

Inter-Rater Agreement

TDS Item Median Score Agreement (%) Expected Agreement (%) Inter-Rater Agreement (κ) p
Vascularity 3 62.2 26.7 0.48 <0.01
Friability 1 62.2 32.5 0.44 <0.01
Mobility/Fibrosis 2 63.1 30.2 0.46 <0.01
Gland Size 3 68.9 24.1 0.59 <0.01

For each item on the TDS scale, the average score between the two surgeons is displayed along with measures of agreement. Cohen’s kappa (κ) is a statistic that evaluates the agreement between two raters where zero indicates an agreement no better than chance and 1 indicates perfect agreement. Also displayed is the percentage of exact agreement (i.e, the exact same score) and the percentage of expected agreement due to chance alone.

TDS = thyroidectomy difficulty scale