Daperno 2011.

Methods	171 gastroenterologists were shown 5 video clips of an endoscopy procedure from a patient with UC All participants rated the video using an iPad system after extensive discussion of scoring modalities
Data	Agreement differed significantly (P < 0.001) after scoring training was conducted for 3/5 video clips
Comparisons	Interrater reliability was measured before training and after training
Outcomes	Interrater reliability (see Table 3)
Notes	Endoscopic scoring index validated: Mayo Clinic Endoscopic Subscore Study published in abstract form only
Risk of bias
Item	Authors' judgement	Description
Blinding?	Yes	Each video was blindly reviewed
Independent Observation?	Unclear	Not adequately described