Osada 2010.

Methods	An inter‐ and intra‐observer agreement study that assessed 4 established endoscopic scoring indices and one novel index
Data	279 endoscopic images of inflamed lesions from 93 UC patients Endoscopic images were displayed twice to 4 expert and 4 trainee endoscopists over an 1 month interval
Comparisons	5 endoscopic scoring indices were assessed
Outcomes	Inter‐rater and intra‐rater reliability (see Table 3)
Notes	Endoscopic scoring indices evaluated: the Matts Score, Mayo Endoscopic Subscore, Baron Score and Blackstone Score were compared to a new Modified 6‐point Activity Index (Osada Score)
Risk of bias
Item	Authors' judgement	Description
Blinding?	Yes	4 expert and 4 trainee endoscopists assessed endoscopic pictures
Independent Observation?	Yes	The images were displayed to the endoscopists independently