Table 2.
Definition of categories and point criteria for scientific evaluation of the quality of the smartphone apps.
| Rating | 0 point | 1 point | |
|---|---|---|---|
| Category: security and privacy | |||
| 1 | Password | The user cannot protect access with a user name and/or password. | The user can protect access with a user name and/or password. |
| 2 | User consent | The user is not able to approve use of one's data (e.g. geographical location, calendar, and photo). | The user can approve use of one's data (e.g. geographical locations, calendar, and photo, through a notification or settings). |
| 3 | User consent revisable | The user does not have the right to modify or revoke consent while using the app. | The user has the right to modify or revoke consent any moment. |
| 4 | Erasing of user data | The app does not allow erasing of user data. | The app allows erasing the user data or gives instructions on how to proceed with erasing. |
| 5 | Data collection | The information on data collection is not available in the terms and conditions. | The information on data collection is available in the terms and conditions. |
| Category: quality of the health-related content | |||
| 6 | Aim | The aim of the app is not provided in the descriptions of the store. | The aim of the application is provided in the descriptions of the store. |
| 7 | Education | Does not provide educational information. | Does provide educational information. |
| 8 | Involvement of healthcare professionals | A message that the app does not substitute healthcare professionals is not available in the app and/or terms and conditions. | A message that the app does not substitute healthcare professionals is available in the app and/or terms and conditions. |
| 9 | Trustworthiness, credibility, and quality of the educational information | Sources with little information, not traceable or not trustworthy. | Verifiable sources with high-quality, sufficient quantity, credible, and evidence-based medicine. |
| Category: quality of the app information management and topic-related information | |||
| 10 | Certification (CE marking) | The application is not CE certified. | The application is CE certified. |
| 11 | Content author's expertise | The content author's expertise is not mentioned. | The content author's expertise is mentioned. |
| 12 | Evaluation by target population | The app does not mention if an evaluation by the target population has been performed. | The app mentions that an evaluation by the target population has been performed. |
| 13 | Declaration of interest | A declaration of interest is not mentioned. | A declaration of interest is mentioned. |
| 14 | Sources and references | Sources and literature references are not stated. | Sources and literature references are stated. |
| 15 | Funding | The sources of funding are not stated. | The sources of funding are stated. |
| Category: functionality | |||
| 16 | Reminders: text messages and push notifications | The app does not provide a reminder function. | The app provides a reminder function. |
| 17 | Visual feedback (e.g., graphs, statistics) | The app does not provide visual feedback. | The app provides visual feedback. |
| 18 | Meetings (with healthcare professionals) | The app does not allow to arrange meetings. | The app allows to arrange meetings. |
| 19 | Cloud/synchronization of data on different devices | The data is not saved on a cloud. The users are not able to synchronize their user account across different devices. | The data is saved on a cloud. The users are able to synchronize their user account across different devices. |
| 20 | Access and sharing of different phone functions (e.g., between app and camera, calendar) | The user cannot choose to accept sharing and access to data through other apps. | The user can choose to accept sharing and access to data through other apps. |
| 21 | Patient file | No connection to the patient's medical or pharmaceutical files. | Connection possible to the patient's medical or pharmaceutical files. |
| 22 | Manual entries and comments | Comments cannot be entered in the app. | Comments can be entered in the app. |
| 23 | Gamification | The app does not advertise or send notifications for gamification. | The app advertises or sends notifications for gamification. |
| 24 | Support (e.g., hotline, FAQ, user's manual, instructions) | The app does not provide support functions. | The app provides support functions or a FAQ. |
| 25 | Refill (indication of number of remaining doses to anticipate next purchase) | The app does not contain an option for a refill reminder. | The app contains an option for a refill reminder. |
| 26 | Time zone adaptation | The app does not have an option for adaptation to new time zone. | The app provides an option for adaptation to new time zone. |
| Category: esthetics | |||
| 27 | Flexibility | The user cannot choose the interface or functionalities. | The user can choose the interface layout. |
| 28 | Legibility (e.g., text, images) | The app does not provide an option to change font size. | The app provides an option to change font size. |
| 29 | Customization (e.g., design interface, alarm type) | The user cannot customize the app. | The user can customize the app. |
| Category: advertising | |||
| 30 | Advertising | The app contains advertisements. | The app does not contain advertisements. |