Skip to main content
. 2021 Sep 21;23(9):e25171. doi: 10.2196/25171

Table 2.

Quality assessment criteria.

Criterion Description References
QA1a The empirical study adopts a qualitative, quantitative, or mixed method approach. The possible answers are mixed method (+2), and quantitative or qualitative research (+1). [50]
QA2 The study is a fully structured article divided into four basic sections: introduction, methods, results, and discussion. The answers are Yes (+1) and No (+0). [51]
QA3 The study unequivocally describes the research process in sufficient detail. A quantitative study shows the questionnaire items, a qualitative one the coding and categorization process, and an experimental one the details of the experiment. The answers are Yes (+2), Partially (+1), and No (+0). [17]
QA4 The study clearly documents the research implications (contributions or implications) and limitations. The answers are Yes (+2), Partially (+1), and No (+0). [50]
QA5 The study was published in a reliable and recognized publication journal.
Based on Journal Citation Reports (JCR: an annual publication that provides information about academic journals with impact factor data): journal in the top 25% (Q1 +1.5), in the 25%–50% group (Q2 +1), in the 50%–100% group (Q3 or Q4 +0.5), and no JCR ranking (+0).
Conference ranking based on CORE (conference ranking portal): CORE A* or A (+1.5), CORE B (+1), CORE C (+0.5), and no CORE ranking (+0).
[49,52]

aQA: quality assessment.