Skip to main content
. 2019 Nov 18;7(11):e16442. doi: 10.2196/16442

Table 4.

Operationalization of the nine quality principles using 25 detailed questions, via Q3a, according to Albrecht [20].

Question ID Question Contribution
Q301 Has the purpose of the app been specified? Practicality
Q302 Is there a description of functions the app offers in order to fulfill its purpose? Practicality
Q303 Is there a description of the app given that states which methods it employs to fulfill its purpose (eg, procedures, processes, and algorithms with which the offered functions are implemented), and are there statements regarding their suitability for this purpose? Practicality
Q304 Is appropriate evidence cited to support the statements on fulfillment of the purpose of the app (eg, references to studies, guidelines, testing, and quality labels)? Practicality
Q305 Are the suitability and unsuitability for certain app scenarios or user groups specified (eg, in terms of inclusion and exclusion criteria)? Practicality
Q306 Have potential or actual risks the app poses to users or their environment been stated, with respect to health, economic, or social aspects? Risk adequacy
Q307 Have precautions been taken to avoid health, economic, and/or social risks when using the described app? Risk adequacy
Q308 Is there a description about the extent to which the app follows ethical principles, such as patient autonomy, equity of access, and/or professional ethics and research ethics? Ethical soundness
Q309 Are conflicts of interest (eg, authors with affiliations to specific companies) discussed in the app description? Ethical soundness
Q310 Is there a mention of whether the app is being provided in a research context; if so, is there a statement about whether it follows good scientific practice? Ethical soundness
Q311 Is there a statement about whether the relevant general legal requirements, such as data protection law, telemedia law, and commercial law, have been taken into account by the manufacturer and provider of the app? Legal conformity
Q312 Is there a statement about which requirements and regulations have been taken into account with regard to using the app in a health context, such as medical device law or medical professional law? Legal conformity
Q313 Is there a statement about how the quality of the content has been ensured (eg, involvement of experts in the field) or which validated sources have been used (eg, consideration of current scientific findings and guidelines)? Content validity
Q314 Is there a description of how the app is regularly adapted to new content requirements? Content validity
Q315 Is it described to what extent the app corresponds to the current state of the art? Technical adequacy
Q316 Is there information about how the app is regularly adapted to technical requirements? Technical adequacy
Q317 Is there information about to what extent it is possible to switch to another operating system or device without data loss? Technical adequacy
Q318 Is there a mention of whether the app is scalable (ie, adaptable to increasing requirements) or can be integrated into other products? Technical adequacy
Q319 Has information been provided about proof for the app's usability (eg, usability tests)? Usability
Q320 Is it described to what extent the function of the app has been specifically adapted to the target group, whether it is barrier-free, or whether it can be used with individual adaptations? Usability
Q321 Is there information about the extent to which user feedback was considered for the app (eg, during the development process)? Usability
Q322 Is there a statement about how the app ensures efficient use of the available technical resources (eg, required memory, computing power, internal or external sensors, and power consumption)? Resource efficiency
Q323 Is the information about the app sufficient (ie, adequately specified in scope and depth of information)? Transparency
Q324 Is valid (ie, complete and reliable) information about the app provided? Transparency
Q325 Is the information about the app described in a manner that is adequate for the target group? Transparency

aQ3: questionnaire 3.