Table 1.
Quality assessment of the selected studies using modified QUADAS tool. The ‘✓’ demonstrates a favourable response to the question and the ‘X’ demonstrates an unfavourable response to the question. The overall score reflects the quality and risk of bias for each study
| Quality Assessment Questions | Nishitani et al 2021 | Leite et al 2021 | Lee et al 2020 |
Zhao et al 2020 | Mahdi et al 2020 | Mura-matsu et al 2020 | Silva et al 2020 |
Muresan et al 2020 | Chung et al 2020 | Tuzoff et al 2019 | Koch et al 2019 |
Wirtz et al 2018 | Jader et al 2018 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Does the sample size consist of >100 images? | ✓ | ✓ | × | ✓ | ✓ | × | ✓ | ✓ | ✓ | ✓ | ✓ | × | ✓ |
| Was there an explicit inclusion/exclusion criterion defined for dataset selection? | × | ✓ | ✓ | ✓ | × | × | ✓ | × | × | × | ✓ | ✓ | ✓ |
| Did the investigators mention sample size calculation? | × | × | × | × | × | × | × | × | × | × | × | × | × |
| Is the dataset multicentric? | × | × | × | × | × | × | × | ✓ | ✓ | × | × | × | × |
| Was there adequate information provided for replicating study? | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Did the investigators employed any validation techniques in the test data to reduce bias? | × | × | × | ✓ | × | ✓ | ✓ | × | × | × | × | × | × |
| Does the study mention type of specialist involve for annotation? | × | ✓ | ✓ | × | × | ✓ | × | × | × | × | × | × | × |
| Did the investigators report more than one performance metrics? | ✓ | ✓ | ✓ | ✓ | ✓ | × | ✓ | ✓ | ✓ | ✓ | × | × | ✓ |
| Did the investigators employ any data augmentation techniques? | × | ✓ | ✓ | × | × | ✓ | ✓ | ✓ | × | ✓ | ✓ | × | × |
| Overall score | 3 | 6 | 5 | 5 | 3 | 4 | 6 | 5 | 4 | 4 | 4 | 2 | 4 |
High (6-8) score
Moderate (4-5) score
Low (0-3) score