Skip to main content
. 2020 Jul 23;8(7):e17609. doi: 10.2196/17609

Table 5.

Interrater agreement for the Mobile Application Rating Scale domains and evaluation criteria.

Domains and evaluation criteria Weighted Cohen κ Agreement (%)
Engagement 0.76 92.2

Entertainment 0.55 89.4

Interest 0.56 87.8

Customization 0.86 96.8

Interactivity 0.77 91.5

Target group 0.64 88.8
Functionality 0.71 90.0

Performance 0.68 89.9

Ease of use 0.62 89.4

Navigation 0.69 87.9

Gestural design 0.64 87.9
Esthetics 0.80 93.6

Layout 0.75 90.8

Graphics 0.76 93.1

Visual appeal 0.91 96.8
Information 0.79 93.6

Accuracy of the app in the description (App/Play Store) 0.63 89.4

Goals 0.72 93.6

Quality of information 0.67 88.7

Quantity of information 0.65 87.2

Visual information 0.86 94.1

Evidence base 0.66 94.1

Credibility 0.61 89.4
Subjective quality 0.68 89.9

Would you recommend this app to people who might benefit from it? 0.64 90.4

Would you pay for this app? 0.74 90.8

How many times do you think you would use this app in the next 12 months if it was relevant to you? 0.72 90.4

What is your overall star rating of the app? 0.48 86.7