Table 1.

Guidelines for reporting reliability and agreement studies (GRRAS) [7].

Section	Page	Checklist item
Title and abstract	1	Identify in the title or abstract that interrater/intrarater reliability or agreement was investigated.
Introduction	4	Name and describe the diagnostic or measurement device of interest explicitly.
		Specify the subject population of interest. Specify the rater population of interest (if applicable).
		Describe what is already known about reliability and agreement and provide a rationale for the study (if applicable).
Methods	6	Explain how the sample size was chosen. State the determined number of raters, subjects/objects, and replicate observations.
		Describe the sampling method.
		Describe the measurement/rating process (e.g., the time interval between repeated measurements, availability of clinical information, and blinding).
		State whether measurements/ratings were conducted independently.
		Describe the statistical analysis.
Results	9	State the actual number of raters and subjects/objects that were included and the number of replicate observations that were conducted.
		Describe the sample characteristics of raters and subjects (e.g., training and experience).
		Report estimates of reliability and agreement including measures of statistical uncertainty.
Discussion/conclusion	10	Discuss the practical relevance of results.