Skip to main content
. 2022 Jun 29;11(6):e39586. doi: 10.2196/39586

Table 1.

Usability testing objectives and measures.

Phase Participants Objective Evaluation measures
Phase 1: Planning (heuristic evaluation) Study team To evaluate the general usability issues of each prototype

  • Heuristic evaluation
Phase 2: Evaluation with healthy volunteers Healthy volunteers

  • To evaluate the usability and CWLa of the DCEb and BWSc within the prototypes

  • To evaluate the usability of the Personalized Treatment Preferences Dashboard

 Usability

  • Quantitative assessment:

    • PSSUQd

  • Qualitative assessments:

    • Think-aloud sessions

    • Semistructured interviews

Cognitive workload

  • Quantitative assessments:

    • NASA-TLXe

Phase 3: Evaluation with patients, caregivers, and health care workers

  • Patients

  • Caregivers

 To evaluate the usability and CWL of the DCE and BWS within the prototypes Usability

  • Quantitative assessment:

    • PSSUQ

  • Qualitative assessments:

    • Think-aloud sessions

    • Semistructured interviews

Cognitive workload

  • Quantitative assessments:

    • NASA-TLX

  • Qualitative assessment:

    • Cognitive task analysis


Health care workers To evaluate the usability of the DCE and BWS within the prototypes Usability

  • Qualitative assessments:

    • Think-aloud sessions

    • Semistructured interviews

Phase 4: Final evaluation of usability, CWL, and performance

  • Patients

  • Caregivers

 To evaluate the usability, CWL, and performance of the DCE and BWS within the prototypes Usability

  • Quantitative assessments:

    • SEQf

    • PSSUQ

  • Qualitative assessments:

  • Semistructured interviews

Cognitive workload

  • Quantitative assessments:

    • NASA-TLX

  • Qualitative assessment

    • Cognitive task analysis

Performance

  • Quantitative assessments:

    • Time to complete

    • Number of errors

    • Eye-tracking


Health care workers To evaluate the usability of the DCE and BWS within the prototypes Usability

  • Qualitative assessments:

    • Think-aloud sessions

    • Semistructured interviews

aCWL: cognitive workload.

bDCE: discrete choice experiment.

cBWS: best-worst scaling.

dPSSUQ: Post-Study System Usability Questionnaire.

eNASA-TLX: National Aeronautical and Space Administration’s Task Load Index.

fSEQ: Single Easy Questionnaire.