Table 2.
Average Appraisal Scores and Average Overall Assessments of Each Guideline
| Guideline | Metric | Appraiser 1 | Appraiser 2 | Average | Standard Deviation |
|---|---|---|---|---|---|
|
Raine et al. 2022 [37] & Spinelli et al. 2022 [38] (Overall) |
Appraisal Score | 5.5 | 5.5 | 5.5 | 0.0 |
| Overall Assessment | 6.0 | 5.0 | 5.5 | 0.7 | |
|
Raine et al. 2022 [37] & Spinelli et al. 2022 [38] (CAM Section) |
Appraisal Score | 4.2 | 4.0 | 4.1 | 0.0 |
| Overall Assessment | 4.0 | 4.0 | 4.0 | 0.0 | |
|
Lodyga et al. 2021 [42] (Overall) |
Appraisal Score | 3.9 | 4.0 | 3.9 | 0.0 |
| Overall Assessment | 4.0 | 4.0 | 4.0 | 0.0 | |
|
Lodyga et al. 2021 [42] (CAM Section) |
Appraisal Score | 3.0 | 3.3 | 3.1 | 0.2 |
| Overall Assessment | 4.0 | 4.0 | 4.0 | 0.0 | |
|
Miehlke et al. 2021 [43] (Overall) |
Appraisal Score | 5.0 | 4.7 | 4.8 | 0.2 |
| Overall Assessment | 5.0 | 5.0 | 5.0 | 0.0 | |
|
Miehlke et al. 2021 [43] (CAM Section) |
Appraisal Score | 4.1 | 4.1 | 4.1 | 0.0 |
| Overall Assessment | 4.0 | 4.0 | 4.0 | 0.0 | |
|
Levine et al. 2020 [47] (Overall) |
Appraisal Score | 3.9 | 3.8 | 3.9 | 0.1 |
| Overall Assessment | 4.0 | 4.0 | 4.0 | 0.0 | |
|
Levine et al. 2020 [47] (CAM Section) |
Appraisal Score | 3.3 | 3.3 | 3.3 | 0.0 |
| Overall Assessment | 3.0 | 3.0 | 3.0 | 0.0 | |
|
Colombel et al. 2019 [48] (Overall) |
Appraisal Score | 3.7 | 3.5 | 3.6 | 0.2 |
| Overall Assessment | 4.0 | 3.0 | 3.5 | 0.7 | |
|
Colombel et al. 2019 [48] (CAM Section) |
Appraisal Score | 3.5 | 3.1 | 3.3 | 0.3 |
| Overall Assessment | 3.0 | 3.0 | 3.0 | 0.0 | |
|
Ko et al. 2019 [53] (Overall) |
Appraisal Score | 4.8 | 4.7 | 4.8 | 0.1 |
| Overall Assessment | 5.0 | 5.0 | 5.0 | 0.0 | |
|
Ko et al. 2019 [53] (CAM Section) |
Appraisal Score | 4.3 | 4.0 | 4.2 | 0.2 |
| Overall Assessment | 4.0 | 3.0 | 3.5 | 0.7 | |
| Kucharzik et al. 2019 [54] (Overall) | Appraisal Score | 5.5 | 5.4 | 5.5 | 0.1 |
| Overall Assessment | 6.0 | 5.0 | 5.5 | 0.7 | |
| Kucharzik et al. 2019 [54] (CAM Section) | Appraisal Score | 4.9 | 5.0 | 4.9 | 0.1 |
| Overall Assessment | 5.0 | 5.0 | 5.0 | 0.0 | |
| Panaccione et al. 2019a [56] & Panaccione et al. 2019b [57] (Overall) | Appraisal Score | 5.2 | 5.4 | 5.3 | 0.2 |
| Overall Assessment | 5.0 | 5.0 | 5.0 | 0.0 | |
| Panaccione et al. 2019a [56] & Panaccione et al. 2019b [57] (CAM Section) | Appraisal Score | 4.3 | 4.6 | 4.4 | 0.2 |
| Overall Assessment | 4.0 | 5.0 | 4.5 | 0.7 | |
|
Sood et al. 2019 [59] (Overall) |
Appraisal Score | 4.4 | 4.5 | 4.4 | 0.1 |
| Overall Assessment | 4.0 | 4.0 | 4.0 | 0.0 | |
|
Sood et al. 2019 [59] (CAM Section) |
Appraisal Score | 3.8 | 4.0 | 3.9 | 0.1 |
| Overall Assessment | 4.0 | 4.0 | 4.0 | 0.0 | |
|
Forbes et al. 2017 [66] (Overall) |
Appraisal Score | 4.7 | 4.7 | 4.7 | 0.0 |
| Overall Assessment | 5.0 | 4.0 | 4.5 | 0.7 | |
| Forbes et al. 2017 [66] (CAM Section) | Appraisal Score | 4.5 | 4.3 | 4.4 | 0.1 |
| Overall Assessment | 4.0 | 4.0 | 4.0 | 0.0 | |
|
Nguyen et al. 2017 [68] (Overall) |
Appraisal Score | 4.9 | 5.0 | 4.9 | 0.0 |
| Overall Assessment | 5.0 | 5.0 | 5.0 | 0.0 | |
|
Nguyen et al. 2017 [68] (CAM Section) |
Appraisal Score | 4.0 | 3.8 | 3.9 | 0.2 |
| Overall Assessment | 4.0 | 3.0 | 3.5 | 0.7 | |
|
Bernstein et al. 2016 [69] (Overall) |
Appraisal Score | 3.5 | 4.0 | 3.7 | 0.3 |
| Overall Assessment | 3.0 | 4.0 | 3.5 | 0.7 | |
|
Bernstein et al. 2016 [69] (CAM Section) |
Appraisal Score | 2.9 | 2.7 | 2.8 | 0.2 |
| Overall Assessment | 3.0 | 3.0 | 3.0 | 0.0 | |
|
Harbord et al. 2016 [70] (Overall) |
Appraisal Score | 3.8 | 3.2 | 3.5 | 0.5 |
| Overall Assessment | 4.0 | 3.0 | 3.5 | 0.7 | |
|
Harbord et al. 2016 [70] (CAM Section) |
Appraisal Score | 3.0 | 2.7 | 2.8 | 0.2 |
| Overall Assessment | 4.0 | 3.0 | 3.5 | 0.7 | |
|
Bressler et al. 2015 [71] (Overall) |
Appraisal Score | 4.8 | 5.0 | 4.9 | 0.1 |
| Overall Assessment | 5.0 | 5.0 | 5.0 | 0.0 | |
|
Bressler et al. 2015 [71] (CAM Section) |
Appraisal Score | 4.1 | 4.3 | 4.2 | 0.2 |
| Overall Assessment | 4.0 | 5.0 | 4.5 | 0.7 | |
|
Eliadou et al. 2015 [72] (Overall) |
Appraisal Score | 3.4 | 3.6 | 3.5 | 0.1 |
| Overall Assessment | 4.0 | 3.0 | 3.5 | 0.7 | |
|
Eliadou et al. 2015 [72] (CAM Section) |
Appraisal Score | 2.8 | 2.7 | 2.7 | 0.1 |
| Overall Assessment | 3.0 | 3.0 | 3.0 | 0.0 | |
|
Fichera & Zoccali 2015 [73] (Overall) |
Appraisal Score | 3.3 | 3.0 | 3.2 | 0.2 |
| Overall Assessment | 3.0 | 3.0 | 3.0 | 0.0 | |
|
Fichera & Zoccali 2015 [73] (CAM Section) |
Appraisal Score | 2.6 | 2.3 | 2.5 | 0.2 |
| Overall Assessment | 3.0 | 2.0 | 2.5 | 0.7 | |
|
Lee et al. 2014 [77] (Overall) |
Appraisal Score | 5.0 | 5.2 | 5.1 | 0.1 |
| Overall Assessment | 5.0 | 5.0 | 5.0 | 0.0 | |
|
Lee et al. 2014 [77] (CAM Section) |
Appraisal Score | 4.2 | 4.2 | 4.2 | 0.0 |
| Overall Assessment | 4.0 | 4.0 | 4.0 | 0.0 | |
|
Ueno et al. 2013 [83] (Overall) |
Appraisal Score | 4.6 | 4.7 | 4.6 | 0.0 |
| Overall Assessment | 4.0 | 5.0 | 4.5 | 0.7 | |
|
Ueno et al. 2013 [83] (CAM Section) |
Appraisal Score | 3.7 | 3.7 | 3.7 | 0.0 |
| Overall Assessment | 4.0 | 4.0 | 4.0 | 0.0 | |
|
Mowat et al. 2011 [85] (Overall) |
Appraisal Score | 4.7 | 4.8 | 4.8 | 0.1 |
| Overall Assessment | 5.0 | 5.0 | 5.0 | 0.0 | |
|
Mowat et al. 2011 [85] (CAM Section) |
Appraisal Score | 3.8 | 4.0 | 3.9 | 0.1 |
| Overall Assessment | 4.0 | 4.0 | 4.0 | 0.0 |