Table 7.
Kappa score and interrater reliability for the Mobile App Rating Scale domains.
Domain | Weighted Cohen κ | Agreement, % | |
Engagement | 0.82 | 93.1 | |
|
Entertainment | 0.63 | 86.7 |
|
Interest | 0.72 | 90.4 |
|
Customization | 0.90 | 95.2 |
|
Interactivity | 0.84 | 92.6 |
|
Target group | 0.73 | 90.4 |
Functionality | 0.69 | 90.6 | |
|
Performance | 0.67 | 88.5 |
|
Ease of use | 0.54 | 87.1 |
|
Navigation | 0.64 | 87.9 |
|
Gestural design | 0.71 | 90.3 |
Aesthetics | 0.80 | 93.1 | |
|
Layout | 0.76 | 91.7 |
|
Graphics | 0.76 | 90.7 |
|
Visual appeal | 0.78 | 92.4 |
Information | 0.80 | 93.5 | |
|
Accuracy of the app in the description (Apple App Store and Android Play Store) | 0.77 | 93.1 |
|
Goals | 0.78 | 92.8 |
|
Quality of information | 0.73 | 91.0 |
|
Quantity of information | 0.67 | 88.6 |
|
Visual information | 0.63 | 86.4 |
|
Evidence base | 0.91 | 96.3 |
|
Credibility | 0.84 | 94.3 |
Subjective quality | 0.80 | 92.8 | |
|
Would you recommend this app to people who might benefit from it? | 0.78 | 91.5 |
|
Would you pay for this app? | 0.86 | 94.2 |
|
How many times do you think you would use this app in the next 12 months if it was relevant to you? | 0.77 | 90.3 |
|
What is your overall star rating of the app? | 0.79 | 92.2 |