Table 2.
Results of the agreement and changes made to definitions following round 1 of the Delphi (N=29).
| Term | Proposed definition | Agreement, n (%) | Final definition |
| Usability assessment moderator | The person who conducts the usability evaluation interacts with the participant and guides the session. | 24 (83) | The same as the initially proposed |
| Participant | The person who is asked to evaluate the usability of a product or service and who completes the tasks, following the indications of the evaluator. | 27 (93) | The same as the initially proposed |
| Usability evaluation method | A set of techniques used to perform usability evaluation at different stages of the product or service development (eg, inquirya or testb methods). | 25 (86) | The same as the initially proposed |
| Usability evaluation technique | A set of procedures used to perform the usability evaluation and collect data of a certain type (eg, brainstorming, questionnaire, and think aloud). | 25 (86) | A set of procedures used to perform the usability evaluation and collect either qualitative or quantitative data (eg, focus group, survey, think aloud, and performance) |
| Tasks | The activities that participants are asked to perform when evaluating the usability of a product or service. | 29 (100) | Self-contained or independent activities that participants are asked to perform when evaluating the usability of a product or service within a limited period |
| Usability evaluation environment | The environment where the evaluation of usability takes place: (1) laboratory or controlled conditions and (2) in a real context, that is, the usability evaluation is carried out in the same context and circumstances where the end product is expected to be used. | 27 (93) | The same as the initially proposed |
| Usability evaluator | A person with knowledge and experience on HCIc, usability, and user experience who conducts the usability inspection (eg, an HCI specialist assigned to evaluate the interface of technology for patients with diabetes). | 29 (100) | The same as the initially proposed |
| Domain evaluator | A person with knowledge on the application area of the technology under development (eg, a physician involved in treating patients with diabetes). | 28 (97) | A person with knowledge of the application area of the technology under development that provides feedback about functionalities of the technological product or service (eg, a physician involved in treating patients with diabetes who provides feedback about technology for patients with diabetes) |
aInquiry methods involve collecting qualitative data from users.
bTesting methods involve observing the user while interacting with the product or service and consist of collecting mostly quantitative data.
cHCI: human-computer interaction.