Walsh 2009.

Methods	Purpose was to determine the impact of inter‐rater reliability on inclusion criteria and outcomes in clinical trials
Data	100 patients with UC were seen independently, on the same day, by 4 gastroenterologists Clinical assessments of disease activity were performed on the same day as sigmoidoscopy
Comparisons	3 endoscopic scoring indices were evaluated
Outcomes	Inter‐rater reliability (see Table 3)
Notes	Endoscopic scoring index evaluated: Baron Score, Modified Baron Score, Mayo Endoscopic Subscore Study reported in abstract form only
Risk of bias
Item	Authors' judgement	Description
Blinding?	Yes	The clinician and endoscopist were blinded
Independent Observation?	Unclear	Not adequately described

SCCAI: Simple Clinical Colitis Activity Index

UC: ulcerative colitis

EAI: Endoscopic Activity Index

UCDAI: Ulcerative Colitis Disease Activity Index

UCEIS: Ulcerative Colitis Endoscopic Index of Severity

CD: Crohn's disease

UCCIS: Ulcerative Colitis Colonoscopic Index of Severity