Daperno 2014.

Methods	14 expert gastroenterologists reviewed 13 UC videos (in addition to 10 postoperative and 8 luminal Crohn's disease videos) A subset of 5 of the endoscopic clips were also reviewed by 30 general gastroenterologists without experience performing endoscopic scoring
Data	Expert gastroenterologists: belonged to tertiary referral centres, had previous experience using IBD scores, median duration of practice was 21 years, median number of patients followed was 1750 Non‐expert gastroenterologists: belonged to primary/secondary referral centres, had basic experience in endoscopy but no formal training in scoring instruments (they were briefly introduced to the indices before being asked to score videos)
Comparisons	Interrater reliability for expert gastroenterologists and non‐expert gastroenterologists
Outcomes	Interrater reliability (see Table 3)
Notes	Endoscopic scoring index evaluated: The Mayo Clinic Endoscopic Subscore
Risk of bias
Item	Authors' judgement	Description
Blinding?	Unclear	Not adequately described
Independent Observation?	Unclear	After every round of video scoring, the raters were permitted to discuss, but not change their scores