Skip to main content
. 2022 Mar 25;9(1):e26461. doi: 10.2196/26461

Table 2.

Heuristic evaluation results.

Heuristic Rating Strengths Areas for improvement
1. Visibility of system status 3
  • System showed current status effectively in main survey sections via page counts, color confirmation, and written confirmation

  • System status and future options were not as apparent in additional help sections

2. Real-world match 2
  • Survey section numbering, sequence, and naming were logical and consistent with real world conventions

  • Survey questions follow conventions for type and format

  • Embedded YouTube videos take advantage of familiar features, platform

  • Procedure for leaving and returning was not conventional or natural

  • “Survey” terms in standardized research questionnaires did not match real-world conventions

  • Additional section links are hard to find, and function in unconventional and nonnatural ways

3. User control 2
  • Reset function was an effective undo feature

  • “Emergency exits” were unclear in additional help sections

4. Consistency 2
  • Main survey sections used consistent layout, functioning, color, and terms

  • Pop-up boxes, formatting, headers, and tone were inconsistent within and across pages

5. Error prevention 3
  • Several effective error prevention features (eg, prohibits leaving questions unanswered)

  • No prevention against accidentally closing whole survey window without saving

6. Recognition 3
  • Instructions for system use are readily available throughout

  • Questionnaires and check-ins provide built-in references to past information

  • Educational videos, FAQa, and additional resources are available at the bottom of each page

  • Contents and options are not centrally listed in the additional vocal health tips sections

7. Flexibility 3
  • Font resize option is available

  • Survey queue automatically accordions up as surveys are completed, but still provides an option to view all

  • Menus with links to additional resources and vocal health tips sections cannot be hidden

8. Aesthetic 3
  • Aesthetic is simple, neutral, and uncluttered

  • Some images in the additional vocal health tips sections are less relevant and therefore less impactful than they could be

9. Error messaging 3
  • Error messaging is clear and provides both an explanation and a solution

  • None identified

10. Help and documentation 2
  • FAQ and help email are readily available on survey queue/home page

  • FAQ is available on all main survey pages

  • Instructions for use are available throughout the module

  • Help is not searchable

  • No documentation for technical issues

  • No centralized overview of instructions, features, problems, and complex tasks

aFAQ: frequently asked question.