Skip to main content
. 2021 Jul 2;7:e609. doi: 10.7717/peerj-cs.609

Table 5. Assessment questions for evaluating existing literature reviews.

No. Questions Answers Scale Relevance Rigor
Q1 Whether the aims of the analyzed survey and this survey match? Yes/Part/No 1/0.5/0 X
Q2 Whether the sources used in the analyzed survey and in this survey match? Yes/Part/No 1/0.5/0 X
Q3 Whether the meaning of research questions in the analyzed survey and in this survey similar? Yes/Part/No 1/0.5/0 X
Q4 Whether the search keywords in the analyzed survey and this survey cover the similar field of research? Yes/Part/No 1/0.5/0 X
Q5 Is the analyzed survey based on literature review guidelines agreed in software engineering? Yes/No 1/0 X X
Q6 Is the analyzed survey based on authors’ defined approach? (if previous question is No) Yes/No 0.5/0 X X
Q7 Does the analyzed survey identifies and mitigates its threats to validity? Yes/Part/No 1/0.5/0 X X
Q8 Does the analyzed survey include a quality assessment of the performed search? Yes/Part/No 1/0.5/0 X X
Q9 Does the analyzed survey include a quality assessment of primary studies? Yes/Part/No 1/0.5/0 X
Q10 Are the results presented in the analyzed survey described properly? Yes/Part/No 1/0.5/0 X
Q11 Does the analyzed survey have described examples of flexibility or variability? Yes/Part/No 1/0.5/0 X X
Q12 Does the analyzed survey have answered to the defined research questions? Yes/Part/No 1/0.5/0 X X
Q13 Does the analyzed survey have presented evident conclusions? Yes/Part/No 1/0.5/0 X
Maximum value 12 11 8
Minimum value 0 0 0