Table 2.
Characteristics of included articles.
| Study number | Study | Population (N) | Research design: data collection method | Usability attributes |
| 1 | Aebersold et al [24], 2018, United States | Nursing (N=69) | Mixed methods: questionnaire; task and knowledge performancea | Ease of use; learning performance; satisfaction; usefulness |
| 2 | Akl et al [25], 2008, United States | Resident (N=30) | Qualitative methods: focus groups; written qualitative reflections | Satisfaction |
| 3 | Al-Rawi et al [26], 2015, United States | Dentist (N=61) | Posttest 1-group design: questionnaire | Ease of use; frequency of use; satisfaction; usefulness |
| 4 | Albrecht et al [27], 2013, Germany | Medicine (N=6) | Posttest 1-group design: questionnaireb | Satisfaction |
| 5 | Alencar Neto et al [28], 2020, Brazil | Medicine (N=132) | Posttest 1-group design: questionnaireb | Ease of use; learnability; satisfaction; usefulness |
| 6 | Alepis and Virvou [29], 2010, Greece | Medicine (N=110) | Mixed methods: questionnaire; interviews | Ease of use; usefulness; user-friendliness |
| 7 | Ameri et al [30], 2020, Iran | Pharmacy (N=241) | Posttest 1-group design: questionnaireb | Context of use; efficiency; usefulness |
| 8 | Balajelini and Ghezeljeh [31], 2018, Iran | Nursing (N=41) | Posttest 1-group design: questionnaire | Ease of use; frequency of use; navigation; satisfaction; simplicity; usefulness |
| 9 | Barnes et al [32], 2015, United Kingdom | Medicine (N=42) | Randomized controlled trial: questionnaire; task and knowledge performance | Ease of use; effectiveness; learning performance; satisfaction |
| 10 | Busanello et al [33], 2015, Brazil | Dentist (N=62) | Pre-post test, nonrandomized control group design: questionnaireb | Learnability; learning performance; satisfaction |
| 11 | Cabero-Almenara and Roig-Vila [34], 2019, Spain | Medicine (N=50) | Pre-post test, 1-group design: questionnaireb | Learning performance; satisfaction |
| 12 | Choi et al [35], 2015, South Korea | Nursing (N=5) | Think-aloud methods: interviews; data from app | Context of use; ease of use; learnability; satisfaction; usefulness |
| 13 | Choi et al [36], 2018, South Korea | Nursing (N=75) | Pre-post test, nonrandomized control group design: questionnaire | Ease of use; learning performance; satisfaction; usefulness |
| 14 | Choo et al [37], 2019, Singapore | Psychology (N=8) | Mixed methods: questionnaireb; written qualitative reflections | Ease of use; learning performance; satisfaction; usefulness; user-friendliness |
| 15 | Chreiman et al [38], 2017, United States | Medicine (N=30) | Posttest 1-group design: questionnaire; data from app | Context of use; ease of use; frequency of use; usefulness |
| 16 | Colucci et al [39], 2015, United States | Medicine (N=115) | Posttest 1-group design: questionnaire | Effectiveness; efficiency; satisfaction; usefulness |
| 17 | Davids et al [40], 2014, South Africa | Residents (N=82) | Randomized controlled trial: questionnaireb; data from app | Effectiveness; efficiency; learnability; navigation; satisfaction; user-friendliness |
| 18A | Demmans et al [41], 2018, Canada | Nursing (N=60) | Pre-post test, nonrandomized control group design: questionnaire; observations | Ease of use; effectiveness; learnability; learning performance; navigation; satisfaction |
| 18B | Demmans et al [41], 2018, Canada | Nursing (N=85) | Pre-post test, nonrandomized control group design: questionnaire; observations | Ease of use; effectiveness; learnability; learning performance; navigation; satisfaction |
| 19 | Devraj et al [42], 2021, United States | Pharmacy (N=89) | Posttest 1-group design: questionnaire; data from app | Ease of use; errors; frequency of use; learning performance; navigation; operational usability; satisfaction; usefulness |
| 20 | Díaz-Fernández et al [43], 2016, Spain | Physiotherapy (N=110) | Posttest 1-group design: questionnaire | Comprehensibility; ease of use; usefulness |
| 21 | Docking et al [44], 2018, United Kingdom | Paramedic (N=24) | Think-aloud methods: focus groups | Context of use; learnability; satisfaction; usefulness |
| 22 | Dodson and Baker [45], 2020, United States | Nursing (N=23) | Qualitative methods: focus groups | Ease of use; operational usability; satisfaction; usefulness; user-friendliness |
| 23 | Duarte Filho et al [46], 2014, Brazil | Medicine (N=10) | Posttest nonrandomized control group design: questionnaire | Ease of use; efficiency; satisfaction; usefulness |
| 24 | Duggan et al [47], 2020, Canada | Medicine (N=80) | Posttest 1-group design: questionnaire; data from app | Ease of use; frequency of use; satisfaction; usefulness |
| 25 | Fernandez-Lao et al [48], 2016, Spain | Physiotherapy (N=49) | Randomized controlled trial: questionnaireb; task and knowledge performance | Learning performance; satisfaction |
| 26 | Fralick et al [49], 2017, Canada | Medicine (N=62) | Pre-post test, nonrandomized control group design: questionnaire | Ease of use; frequency of use; learning performance; usefulness |
| 27 | Ghafari et al [50], 2020, Iran | Nursing (N=8) | Posttest 1-group design: questionnaire | Ease of use; operational usability; satisfaction; usefulness |
| 28 | Goldberg et al [51], 2014, United States | Medicine (N=18) | Posttest 1-group design: questionnaire; task and knowledge performance | Ease of use; effectiveness |
| 29 | Gutiérrez-Puertas et al [52], 2021, Spain | Nursing (N=184) | Randomized controlled trial: questionnaire; task and knowledge performance | Learning performance; satisfaction |
| 30 | Herbert et al [53], 2021, United States | Nursing (N=33) | Randomized controlled trial: questionnaire; task and knowledge performance | Ease of use; learning performance; navigation; operational usability; usefulness |
| 31 | Hsu et al [54], 2019, Taiwan | Nursing (N=16) | Qualitative methods: interviews | Context of use; operational usability; satisfaction; usefulness |
| 32 | Huang et al [55], 2010, Taiwan | Not clear (N=28) | Posttest 1-group design: questionnaire | Ease of use; satisfaction, usefulness |
| 33 | Hughes and Kearney [56], 2017, United States | Occupational therapy (N=19) | Qualitative methods: focus groups | Efficiency; satisfaction |
| 34 | Ismail et al [57], 2018, Malaysia | Health science (N=124) | Pre-post test, 1-group design: questionnaire | Ease of use; learning performance; satisfaction; user-friendliness |
| 35 | Johnson et al [58], 2021, Norway | Occupational therapy, physiotherapy, and social education (N=15) | Qualitative methods: focus groups | Context of use; ease of use; operational usability |
| 36A | Kang Suh [59], 2018, South Korea | Nursing (N=92) | Pre-post test, nonrandomized control group design: questionnaire; data from app | Effectiveness; frequency of use; learning performance; satisfaction |
| 36B | Kang Suh [59], 2018, South Korea | Nursing (N=49) | Qualitative methods: focus groups | Effectiveness; frequency of use; learning performance; satisfaction |
| 37 | Keegan et al [60], 2016, United States | Nursing (N=116) | Posttest nonrandomized control group design: questionnaire; task and knowledge performance | Learning performance; satisfaction; usefulness |
| 38 | Kim-Berman et al [61], 2019, United States | Dentist (N=93) | Posttest 1-group design: questionnaire; task and knowledge performance | Context of use; ease of use; effectiveness; usefulness |
| 39 | Kojima et al [62], 2011, Japan | Physiotherapy and occupational therapy (N=41) | Pre-post test, 1-group design: questionnaire | Ease of use; learning performance; satisfaction; usefulness |
| 40 | Koulias et al [63], 2012, Australia | Medicine (N=171) | Posttest 1-group design: questionnaire | Ease of use; operational usability; satisfaction |
| 41 | Kow et al [64], 2016, Singapore | Medicine (N=221) | Pre-post test, 1-group design: questionnaire | Learning performance; satisfaction |
| 42 | Kurniawan and Witjaksono [65], 2018, Indonesia | Medicine (N=30) | Posttest 1-group design: questionnaire | Satisfaction; usefulness |
| 43A | Lefroy et al [66], 2017, United Kingdom | Medicine (N=21) | Qualitative methods: focus groups; data from app | Context of use; frequency of use; satisfaction |
| 43B | Lefroy et al [66], 2017, United Kingdom | Medicine (N=405) | Quantitative methods: data from app | Context of use; frequency of use; satisfaction |
| 44 | Li et al [67], 2019, Taiwan | Health care (N=70) | Pre-post test, nonrandomized control group design: questionnaireb | Ease of use; usefulness |
| 45 | Lin and Lin [68], 2016, Taiwan | Nursing (N=36) | Pre-post test, nonrandomized control group design: questionnaire | Cognitive load; ease of use; learnability; learning performance; usefulness |
| 46 | Lone et al [69], 2019, Ireland | Dentist (N=59) | Randomized controlled trial: questionnaire; task and knowledge performance | Ease of use; learnability; learning performance; operational usability; satisfaction |
| 47A | Long et al [70], 2016, United States | Nursing (N=158) | Pre-post test, 1-group design: questionnaire; data from app | Ease of use; efficiency; learnability; learning performance; satisfaction |
| 47B | Long et al [70], 2016, United States | Health science (N=159) | Randomized controlled trial: questionnaire; data from app | Ease of use; efficiency; learnability; learning performance; satisfaction |
| 48 | Longmuir [71], 2014, United States | Medicine (N=56) | Posttest 1-group design: questionnaire; data from app | Efficiency; learnability; operational usability; satisfaction |
| 49 | López et al [72], 2016, Spain | Medicine (N=67) | Posttest 1-group design: questionnaireb | Context of use; ease of use; errors; satisfaction; usefulness |
| 50 | Lozano-Lozano et al [73], 2020, Spain | Physiotherapy (N=110) | Randomized controlled trial: questionnaire; task and knowledge performance | Learning performance; satisfaction; usefulness |
| 51 | Lucas et al [74], 2019, Australia | Pharmacy (N=39) | Pre-post test, 1-group design: questionnaire; task and knowledge performance | Satisfaction; usefulness |
| 52 | Mathew et al [75], 2014, Canada | Medicine (N=5) | Think-aloud methods: questionnaireb; interviews; task and knowledge performance | Learnability; satisfaction |
| 53 | McClure [76], 2019, United States | Nursing (N=16) | Posttest 1-group design: questionnaireb | Learnability; satisfaction; usefulness |
| 54 | McDonald et al [77], 2018, Canada | Medicine (N=20) | Pre-post test, 1-group design: questionnaire; data from app | Effectiveness; satisfaction |
| 55 | McLean et al [78], 2014, Australia | Medicine (N=58) | Mixed methods: questionnaire; focus groups; interviews | Satisfaction |
| 56 | McMullan [79], 2018, United Kingdom | Health science (N=60) | Pre-post test, 1-group design: questionnaire | Learning performance; navigation; satisfaction; usefulness; user-friendliness |
| 57 | Mendez-Lopez et al [80], 2021, Spain | Psychology (N=67) | Pre-post test, 1-group design: questionnaire; task and knowledge performance | Cognitive load; ease of use; learning performance; satisfaction; usefulness |
| 58 | Meruvia-Pastor et al [81], 2016, Canada | Nursing (N=10) | Pre-post test, 1-group design: questionnaire; task and knowledge performance | Ease of use; learning performance; satisfaction; usefulness |
| 59 | Mettiäinen [82], 2015, Finland | Nursing (N=121) | Mixed methods: questionnaire; focus groups | Ease of use; usefulness |
| 60 | Milner et al [83], 2020, United States | Medicine and nursing (N=66) | Posttest 1-group design: questionnaire | Satisfaction; usefulness |
| 61 | Mladenovic et al [84], 2021, Serbia | Dentist (N=56) | Posttest 1-group design: questionnaire | Context of use; ease of use; satisfaction; usefulness |
| 62 | Morris and Maynard [85], 2010, United Kingdom | Physiotherapy and nursing (N=19) | Pre-post test, 1-group design: questionnaire | Context of use; ease of use; navigation; operational usability; usefulness |
| 63A | Nabhani et al [86], 2020, United Kingdom | Pharmacy (N=56) | Posttest 1-group design: questionnaire | Ease of use; learnability; learning performance; satisfaction; usefulness |
| 63B | Nabhani et al [86], 2020, United Kingdom |
Pharmacy (N=152) | Posttest 1-group design: questionnaire | Ease of use; learnability; learning performance; satisfaction; usefulness |
| 63C | Nabhani et al [86], 2020, United Kingdom |
Pharmacy (N=33) | Posttest 1-group design: task and knowledge performance | Ease of use; learnability; learning performance; satisfaction; usefulness |
| 64A | Noguera et al [87], 2013, Spain | Physiotherapy (N=84) | Posttest 1-group design: questionnaire | Learning performance; satisfaction; usefulness |
| 64B | Noguera et al [87], 2013, Spain | Physiotherapy (N=76) | Randomized controlled trial: questionnaire | Learning performance; satisfaction; usefulness |
| 65 | O’Connell et al [88], 2016, Ireland | Medicine, nursing, and pharmacy (N=89) | Randomized controlled trial: questionnaireb | Ease of use; learning performance; operational usability; satisfaction; simplicity |
| 66 | Oliveira et al [89], 2019, Brazil | Medicine (N=110) | Randomized controlled trial: questionnaire; task and knowledge performance | Frequency of use; learning performance; satisfaction |
| 67 | Orjuela et al [90], 2015, Colombia | Medicine (N=22) | Posttest 1-group design: questionnaire | Ease of use; satisfaction |
| 68 | Page et al [91], 2016, United States | Medicine (N=356) | Mixed methods: questionnaire; interviews | Context of use; efficiency; satisfaction |
| 69 | Paradis et al [92], 2018, Canada | Medicine and nursing (N=108) | Posttest 1-group design: questionnaireb | Ease of use; satisfaction; usefulness |
| 70 | Pereira et al [93], 2017, Brazil | Medicine (N=20) | Posttest 1-group design: questionnaireb | Ease of use; learnability; satisfaction; usefulness |
| 71 | Pereira et al [94], 2019, Brazil | Nursing (N=60) | Posttest 1-group design: questionnaire | Ease of use; operational usability; satisfaction |
| 72A | Pinto et al [95], 2008, Brazil | Biomedical informatics (N=5) | Qualitative methods: observations; task and knowledge performance | Efficiency; errors; learnability; learning performance; operational usability; satisfaction |
| 72B | Pinto et al [95], 2008, Brazil | Medicine (N=not clear) | Posttest nonrandomized control group design: questionnaire | Efficiency; errors; learnability; learning performance; operational usability; satisfaction |
| 73 | Quattromani et al [96], 2018, United States | Nursing (N=181) | Randomized controlled trial: questionnaireb | Learnability; learning performance; satisfaction; usefulness |
| 74 | Robertson and Fowler [97], 2017, United States | Medicine (N=18) | Qualitative methods: focus groups | Satisfaction |
| 75A | Romero et al [98], 2021, Germany | Medicine (N=22) | Think-aloud methods: questionnaire; interviews; task and knowledge performance | Effectiveness; efficiency; errors; navigation; satisfaction |
| 75B | Romero et al [98], 2021, Germany | Medicine (N=22) | Posttest 1-group design: questionnaireb | Learnability; satisfaction |
| 75C | Romero et al [98], 2021, Germany | Medicine (N=736) | Posttest 1-group design: questionnaire | Frequency of use; satisfaction |
| 76 | Salem et al [99], 2020, Australia | Pharmacy (N=33) | Posttest 1-group design: questionnaire | Operational usability; satisfaction; usefulness |
| 77 | San Martín-Rodríguezet al [100], 2020, Spain | Nursing (N=77) | Posttest 1-group design: questionnaire; task and knowledge performance | Learning performance; operational usability; satisfaction |
| 78 | Schnepp and Rogers [101], 2017, United States | Not clear (N=72) | Think-aloud methods: questionnaireb; interviews; task and knowledge performance | Learnability; satisfaction |
| 79 | Smith et al [102], 2016, United Kingdom | Medicine and nursing (N=74) | Mixed methods: questionnaire; focus groups | Navigation; operational usability; satisfaction; user-friendliness |
| 80 | Strandell-Laine et al [103], 2019, Finland | Nursing (N=52) | Mixed methods: questionnaireb; written qualitative responses | Learnability; operational usability; satisfaction |
| 81 | Strayer et al [104], 2010, United States | Medicine (N=122) | Mixed methods: questionnaire; focus groups | Context of use; learnability; learning performance; satisfaction; usefulness |
| 82 | Taylor et al [105], 2010, United Kingdom | A total of 8 different health care educations (N=79) | Qualitative methods: focus groups; written qualitative reflections | Context of use; learnability |
| 83 | Toh et al [106], 2014, Singapore | Pharmacy (N=31) | Posttest 1-group design: questionnaire | Ease of use; learnability; navigation; usefulness |
| 84 | Tsopra et al [107], 2020, France | Medicine (N=57) | Mixed methods: questionnaire; focus groups | Ease of use; operational usability; satisfaction; usefulness |
| 85 | Wu [108], 2014, Taiwan | Nursing (N=36) | Mixed methods: questionnaire; interviews | Cognitive load; effectiveness; satisfaction; usefulness |
| 86 | Wyatt et al [109], 2012, United States | Nursing (N=12) | Qualitative methods: focus groups | Ease of use; efficiency; errors; learnability; memorability; navigation; satisfaction |
| 87 | Yap [110], 2017, Singapore | Pharmacy (N=123) | Posttest 1-group design: questionnaire | Comprehensibility; learning performance; memorability; navigation; satisfaction; usefulness |
| 88 | Zhang et al [111], 2015, Singapore | Medicine (N=185) | Mixed methods: questionnaire; focus groups | Usefulness |
aPerformances measured, comparing paper and app results, quiz results, and exam results.
bReported use of validated questionnaires.