Table 2. Scoring by reviewers for determinants of quality of written feedback.

	Year	Specific	Balanced	Behavioral	Timely	constructive	Quantifiable	Focused	Describe Task	Describe gap	Describe Action plan	Overall agreement % (Studies)	Kappa
Camarata, T. et al. 45	2020	+ + + +	+ + + +	- + + -	- + + +	+ + + +	+ + + +	- - + -	- - - +	- - - +	- + + -	66.7	0.33
Tekian, A. et al. 46	2019	+ + + +	- + + +	- + + +	- - - -	- + + +	+ - + +	- - + -	- - + +	- - - -	- - - -	68.3	0.37
Tomiak. A et al. 53	2019	+ + + +	- - - -	+ + + +	+ + + +	+ + + +	- + + -	+ + + +	- + + +	- + - +	+ + - +	78.3	0.57
Page, M. et al. 51	2019	+ + + +	- - + +	- + + +	- - + +	+ + + +	+ + + +	- - + +	- + + -	- - - -	- + - -	63.3	0.27
Abraham, R. et al. 19	2019	+ + + +	- - + -	- + + +	- - + +	- + + -	+ + + +	- - + -	+ + + +	+ + + +	+ + + +	71.7	0.43
Dallaghan, G. et al. 47	2018	+ + + +	- - + -	+ + + +	- - + +	- - + +	- - + -	- - + -	- + - +	- - - -	+ + - -	58.3	0.17
Karim, A. et al. 48	2017	+ + + +	- + + +	- + + +	- - + +	- + + +	- - + +	+ - + -	- + + +	- - - -	+ + - -	53.3	0.07
Gullbas, L. et al. 57	2016	+ - + +	- + + +	+ + + +	- - + -	+ - + +	- - - +	- - + -	- - - -	- - - -	+ - - -	65.0	0.30
Junod, N. et al. 56	2016	+ + + -	+ + + +	+ + + +	- - + +	- + + +	- + + +	- - + +	- - - +	- + + -	- + + -	53.3	0.07
Nesbitt, A. et al. 52	2014	- + + +	- + - -	- - + +	- - + -	- - + +	- - - -	- + + -	+ - - +	+ + + +	+ - + -	51.7	0.03
Jackson, J. et al. 49	2014	+ + + +	+ + + +	+ + + +	- - + -	+ + + +	+ + - +	- + + +	- - - +	+ - + -	+ + - +	68.3	0.37
Gauthier, S. et al. 54	2014	+ + + +	- - - -	- - + +	- - - -	- - - -	+ + + +	- - + -	+ + + +	+ + + +	+ + + +	88.3	0.77
Pelgrim, E. et al. 55	2012	+ + + +	- + - -	- - + +	- - + +	- - + +	- + + -	- + + -	- + + +	- + + -	+ + + +	50.0	0.00
Canavan, C. et al. 50	2010	+ + + +	- + + +	+ + + +	- - + -	- - + +	- - + -	+ + + -	- + + +	- + + -	- + - -	56.7	0.13
Overall agreement % (determinants)		89.3	66.7	66.7	53.6	61.9	64.3	47.6	56	72.6	58.3
Kappa		0.79	0.33	0.26	0.07	0.33	0.20	- 0.05	0.05	0.45	0.17	--------	------