Table 5.
Quality assessment rating of systematic reviews included in the digital health solutions applied to healthcare workers environment overview.
| Study ID | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | Overall Quality |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Addotey-Delove 2023 | Y | N | N | PY | Y | Y | N | N | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Adepoju 2017 | Y | N | Y | PY | Y | Y | N | PY | N | N | NA | NA | N | Y | NA | Y | Critically Low |
| Agarwal 2015 | Y | N | Y | N | N | N | N | N | N | N | NA | NA | N | N | NA | N | Critically Low |
| Alkhaldi 2023 | Y | N | Y | N | Y | Y | N | Y | Y | N | NM | NM | Y | Y | NM | Y | Critically Low |
| Al-Rawashdeh 2022 | Y | Y | Y | Y | Y | Y | N | PY | Y | Y | NM | NM | Y | Y | NM | Y | Low |
| Amoakoh-Coleman 2016 | Y | PY | Y | N | Y | Y | N | PY | PY | Y | NA | NA | Y | Y | NA | Y | Critically Low |
| Arsad 2023 | Y | N | Y | N | N | N | N | Y | Y | N | NM | NM | N | N | NM | Y | Critically Low |
| Aslani 2022 | Y | N | Y | N | N | Y | N | Y | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Avoka 2022 | Y | Y | Y | Y | Y | Y | N | Y | Y | Y | NM | NM | Y | Y | NM | Y | Low |
| Baluszek 2022 | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y | NM | NM | Y | Y | NM | Y | High |
| Bervell 2019 | Y | N | N | Y | Y | N | N | PY | PY | N | NA | NA | N | N | NA | N | Critically Low |
| Boonstra 2010 | Y | N | Y | N | Y | N | N | Y | N | N | NA | NA | N | N | NA | Y | Critically Low |
| Bommeyer 2023 | Y | Y | Y | PY | Y | Y | N | PY | N | N | NA | NA | N | N | NM | Y | Critically Low |
| Braun 2013 | Y | N | Y | N | Y | Y | N | N | N | N | NA | NA | N | Y | NA | Y | Critically Low |
| Brewster 2014 | Y | N | Y | N | Y | N | N | Y | Y | N | NA | NA | N | N | NA | Y | Critically Low |
| Brown 2020 | Y | PY | Y | N | N | N | N | PY | Y | N | NA | NA | Y | N | NA | N | Critically Low |
| Calleja 2022 | Y | N | Y | N | Y | Y | N | Y | N | N | NM | NM | N | N | NM | N | Critically Low |
| Cansdale 2022 | Y | N | Y | Y | Y | Y | N | Y | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Cartolovni 2022 | Y | N | Y | Y | Y | N | N | Y | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Celes 2018 | Y | PY | Y | PY | Y | Y | N | N | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Cen 2022 | Y | Y | Y | PY | Y | Y | N | Y | N | N | NM | NM | N | Y | NM | Y | Critically Low |
| Chen 2022 | Y | N | Y | PY | N | N | Y | Y | Y | N | NM | NM | N | N | NM | Y | Critically Low |
| Chan 2018 | Y | N | Y | N | Y | N | Y | Y | N | N | NA | NA | N | Y | NA | Y | Critically Low |
| Christensen 2020 | Y | N | Y | PY | Y | N | N | PY | Y | N | NA | NA | Y | N | NA | Y | Critically Low |
| Da Costa 2020 | Y | PY | Y | N | Y | Y | N | PY | N | N | NA | NA | N | N | NA | Y | Critically Low |
| Davis 2014 | Y | N | Y | N | Y | N | N | PY | N | N | NA | NA | N | N | NA | Y | Critically Low |
| de Grood 2016 | Y | N | Y | PY | Y | Y | N | Y | N | N | NA | NA | N | N | NA | Y | Critically Low |
| Drissi 2021 | Y | N | N | N | N | N | N | PY | N | N | NA | NA | N | Y | NA | Y | Critically Low |
| Dutta 2020 | Y | N | Y | N | N | N | N | N | N | N | NA | NA | N | N | NA | Y | Critically Low |
| Early 2019 | Y | N | Y | N | Y | Y | N | N | N | N | NA | NA | N | Y | NA | N | Critically Low |
| Ebneter 2022 | Y | N | Y | N | Y | Y | N | PY | N | N | NM | NM | N | Y | NM | Y | Critically Low |
| Emmett 2022 | Y | PY | Y | N | Y | Y | N | PY | PY | N | NM | NM | Y | N | NM | Y | Critically Low |
| Ferdousi 2021 | Y | Y | Y | N | Y | N | N | N | Y | N | Y | Y | Y | Y | Y | Y | Critically Low |
| Fletcher 2023 | Y | N | Y | PY | Y | Y | N | Y | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Ftouni 2022 | Y | Y | Y | N | Y | Y | N | N | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Gagnon 2012 | Y | Y | Y | N | Y | Y | N | PY | Y | N | NA | NA | Y | Y | NA | N | Critically Low |
| Gagnon 2016 | Y | N | Y | N | N | Y | Y | Y | N | N | NA | NA | N | N | NA | Y | Critically Low |
| Garavand 2022 | Y | N | N | Y | N | Y | N | PY | Y | Y | NM | NM | N | N | NM | Y | Critically Low |
| Garvey 2021 | Y | N | N | PY | N | N | N | Y | Y | Y | NM | NM | Y | Y | NM | Y | Critically Low |
| Ghimire 2023 | Y | Y | Y | Y | Y | Y | N | Y | Y | Y | NM | NM | Y | Y | NM | Y | Low |
| Gonçalves R 2023 | Y | PY | Y | Y | Y | Y | Y | Y | Y | N | NM | NM | Y | N | NM | Y | Critically Low |
| Grant 2022 | Y | Y | Y | Y | Y | Y | N | Y | Y | N | NM | NM | Y | N | NM | Y | Critically Low |
| Hagstram 2022 | Y | Y | Y | PY | Y | Y | N | N | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Huang 2023 | Y | PY | Y | N | Y | Y | N | PY | Y | N | NM | NM | Y | N | NM | Y | Critically Low |
| Ionescu 2022 | Y | N | Y | N | Y | N | N | PY | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Isidori 2022 | Y | N | Y | N | N | N | N | PY | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Ismatullaev 2022 | Y | N | Y | N | Y | Y | N | N | N | N | NM | NM | N | N | NM | N | Critically Low |
| Jacob 2020 | Y | PY | Y | PY | Y | N | N | N | Y | N | NM | NM | N | N | NM | Y | Critically Low |
| Jimenez 2022 | Y | Y | Y | N | Y | Y | N | N | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Jimma 2022 | Y | Y | Y | PY | Y | Y | Y | PY | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Joo 2022 | Y | N | Y | N | N | N | N | N | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Jonasdottir 2022 | Y | Y | Y | Y | Y | Y | N | PY | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Jose 2023 | Y | N | N | PY | Y | N | N | N | N | Y | NM | NM | Y | Y | NM | Y | Critically Low |
| K. Zhang 2022 | Y | N | Y | N | N | N | N | N | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Kane 2022 | Y | N | Y | N | Y | N | N | N | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Keyworth 2018 | Y | PY | Y | PY | Y | N | N | PY | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Koivunen 2018 | Y | Y | N | Y | N | N | N | PY | Y | N | NM | NM | N | Y | NM | Y | Critically Low |
| Kolla 2021 | Y | N | Y | PY | N | N | N | Y | N | N | NA | NA | N | N | NA | Y | Critically Low |
| Konnyu 2023 | Y | Y | Y | PY | Y | Y | N | PY | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Kruse 2022 | Y | PY | N | Y | Y | Y | N | PY | Y | N | NM | NM | Y | N | NM | Y | Critically Low |
| Laar 2022 | Y | Y | Y | Y | Y | Y | N | PY | Y | N | NM | NM | N | N | NM | Y | Critically Low |
| Lam 2022 | Y | N | N | N | N | N | N | PY | N | Y | NM | NM | Y | Y | NM | Y | Critically Low |
| Lampickien 2022 | Y | N | Y | N | N | N | N | N | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Li 2013 | Y | N | Y | N | N | N | N | Y | N | N | NA | NA | N | N | NA | Y | Critically Low |
| Li 2019 | Y | PY | Y | Y | N | N | N | Y | Y | N | NA | NA | Y | N | NA | Y | Low |
| Lluch 2020 | Y | N | Y | PY | N | N | N | N | N | N | NA | NA | N | N | NA | Y | Critically Low |
| Longhini 2022 | Y | Y | Y | Y | Y | Y | N | Y | Y | N | NM | NM | N | N | NM | Y | Critically Low |
| Martin 2019 | Y | Y | Y | Y | Y | Y | N | Y | Y | N | NA | NA | N | Y | NA | Y | Critically Low |
| Marvaso 2022 | Y | PY | N | PY | N | N | N | PY | N | Y | NM | NM | N | N | NM | Y | Critically Low |
| Meunier 2023 | Y | Y | Y | PY | Y | Y | N | PY | Y | Y | NM | NM | Y | Y | NM | Y | Low |
| Moore 2020 | Y | N | Y | PY | Y | Y | N | Y | Y | N | NM | NM | Y | N | NM | Y | Critically Low |
| Muhiyaddin 2020 | Y | N | N | PY | Y | Y | N | N | N | N | NA | NA | N | N | NA | N | Critically Low |
| Mulita 2022 | Y | N | N | PY | N | N | N | N | N | Y | NM | NM | N | Y | NM | Y | Critically Low |
| Namasivayam 2022 | Y | Y | Y | PY | Y | Y | N | Y | N | Y | NM | NM | N | Y | NM | Y | Critically Low |
| Nezamdoust 2022 | Y | N | Y | PY | N | N | N | N | N | Y | NM | NM | N | Y | NM | Y | Critically Low |
| Nguyen 2021 | Y | Y | Y | N | Y | Y | N | Y | N | N | NA | NA | N | Y | NA | Y | Critically Low |
| Niazkhani 2020 | Y | N | Y | N | Y | Y | N | Y | Y | N | NA | NA | N | N | NA | Y | Critically Low |
| Nizeyimana 2022 | Y | Y | Y | Y | Y | Y | N | N | N | N | NA | NA | N | N | NA | Y | Critically Low |
| O’Connor 2022 | Y | N | Y | N | Y | N | N | N | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Odendaal 2020 | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | NA | NA | Y | Y | NA | Y | High |
| Osman 2019 | Y | Y | Y | N | Y | N | N | Y | Y | N | NA | NA | N | N | NA | Y | Critically Low |
| Papadopoulos 2018 | Y | N | Y | N | Y | Y | N | PY | N | N | NM | NM | N | Y | NM | N | Critically Low |
| Police 2011 | Y | N | N | Y | N | N | N | PY | N | N | NA | NA | N | N | NA | Y | Critically Low |
| Prakash 2022 | Y | Y | Y | Y | Y | Y | N | N | N | N | NA | NA | N | N | NA | Y | Critically Low |
| Rahal 2021 | Y | Y | Y | N | Y | Y | N | Y | Y | N | NA | NA | Y | N | NA | Y | Critically Low |
| Ramachandran 2023 | Y | Y | Y | Y | Y | Y | N | Y | N | N | NA | NA | N | N | NA | Y | Critically Low |
| Ratshidi 2022 | Y | Y | Y | PY | N | N | N | N | N | N | NA | NA | N | N | NA | Y | Critically Low |
| Rukavina 2021 | Y | Y | Y | N | Y | Y | Y | Y | N | N | NA | NA | N | N | NA | Y | Critically Low |
| Saigi-Rubio 2022 | Y | Y | Y | N | Y | Y | N | Y | Y | Y | NM | NM | Y | N | NM | Y | Critically Low |
| Sipanoun 2022 | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | NM | NM | Y | Y | NM | Y | Low |
| Sullivan 2022 | Y | N | N | N | N | N | N | PY | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Poissant 2005 | Y | N | Y | Y | Y | N | N | Y | N | N | NA | NA | N | Y | NA | Y | Critically Low |
| Tabaeeian 2022 | Y | N | Y | N | Y | Y | N | N | N | N | NM | NM | N | N | NM | N | Critically Low |
| Tegegne 2023 | Y | PY | N | PY | N | Y | N | Y | N | Y | Y | N | N | Y | Y | Y | Critically Low |
| Thomas Craig 2021 | Y | Y | Y | Y | Y | Y | N | Y | Y | N | NA | NA | N | Y | NA | Y | Critically Low |
| Tickner 2023 | Y | N | Y | Y | N | N | N | Y | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Torres-Castano 2023 | Y | Y | Y | Y | Y | N | Y | Y | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Vejdani 2022 | Y | PY | Y | PY | Y | N | N | Y | N | N | NM | NM | N | Y | NM | Y | Critically Low |
| Verma 2022 | Y | Y | Y | N | Y | N | N | Y | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Von Wedel 2020 | Y | PY | N | Y | Y | N | Y | Y | N | N | NA | NA | N | Y | NA | Y | Critically Low |
| Walle 2023 | Y | PY | Y | PY | Y | N | N | Y | Y | Y | Y | Y | Y | Y | Y | Y | Critically Low |
| Walsh 2021 | Y | N | Y | PY | N | N | N | Y | N | Y | NM | NM | N | Y | NM | Y | Critically Low |
| Wisner 2019 | Y | PY | Y | Y | N | N | N | PY | Y | N | NA | NA | N | N | NA | N | Critically Low |
| Xyrichis 2021 | Y | Y | Y | Y | Y | Y | Y | Y | Y | N | NA | NA | Y | Y | NA | Y | High |
| Young 2011 | Y | N | N | Y | Y | N | N | Y | N | N | NA | NA | N | Y | NA | Y | Critically Low |
| Zakerabasali 2021 | Y | N | Y | N | Y | Y | N | Y | N | N | NA | NA | N | N | NA | Y | Critically Low |
| Zhang J 2023 | Y | N | N | N | Y | N | N | N | N | N | NM | NM | N | N | NM | Y | Critically Low |
| Zhang Z 2023 | Y | N | Y | N | Y | Y | N | N | N | N | NM | NM | N | N | NM | Y | Critically Low |
Judgement was performed by two reviews authors and based on the AMSTAR-2 approach.
Domain 1—Did the research questions and inclusion criteria for the review include the components of PICO?
Domain 2—Did the report of the review contain an explicit statement that the review methods were established prior to the conduct of the review and did the report justify any significant deviations from the protocol?
Domain 3—Did the review authors explain their selection of the study designs for inclusion in the review?
Domain 4—Did the review authors use a comprehensive literature search strategy?
Domain 5—Did the review authors perform study selection in duplicate?
Domain 6—Did the review authors perform data extraction in duplicate?
Domain 7—Did the review authors provide a list of excluded studies and justify the exclusions?
Domain 8—Did the review authors describe the included studies in adequate detail?
Domain 9—Did the review authors use a satisfactory technique for assessing the risk of bias (RoB) in individual studies that were included in the review?
Domain 10—Did the review authors report on the sources of funding for the studies included in the review?
Domain 11—If meta-analysis was performed did the review authors use appropriate methods for statistical combination of results?
Domain 12—If meta-analysis was performed, did the review authors assess the potential impact of RoB in individual studies on the results of the meta-analysis or other evidence synthesis?
Domain 13—Did the review authors account for RoB in individual studies when interpreting/ discussing the results of the review?
Domain 14—Did the review authors provide a satisfactory explanation for, and discussion of, any heterogeneity observed in the results of the review?
Domain 15—If they performed quantitative synthesis did the review authors carry out an adequate investigation of publication bias (small study bias) and discuss its likely impact on the results of the review?
Domain 16—Did the review authors report any potential sources of conflict of interest, including any funding they received for conducting the review.