Table III.
Number of usability problems by method and theme.
| User interface-related themes | Number of findings (%) | |||
|---|---|---|---|---|
| User testing | Interview | Survey | Totals | |
| Time consuming to enter a diagnosis | 5 (14) | 17 (50) | 13(36) | 35(19) |
| Illogical ordering of terms | 5 (33) | 5 (33) | 5(34) | 15 (8) |
| Inconsistent naming and placement of user interface widgets | 12 (86) | 2 (14) | 0 | 14(8) |
| Search results do not match users expectations | 9 (70) | 2 (15) | 2(15) | 13(7) |
| Ineffective feedback to confirm diagnosis entry | 7 (88) | 1(12) | 0 | 8(4) |
| Users unaware of important functions to help find a diagnosis | 7 (100) | 0 | 0 | 7(4) |
| Limited flexibility in user interface | 3(50) | 3(50) | 0 | 6(3) |
| Inappropriate granularity / specificity of concepts | 2 (33) | 4 (67) | 0 | 6(3) |
| Term names not fully visible | 2 (67) | 1(33) | 0 | 3(2) |
| Distinction between the category name and preferred term in terminology unclear | 2 (100) | 0 | 0 | 2 (1) |
| Diagnosis terminology-related themes | ||||
| Some concepts appear missing / not included | 11 (55) | 1(5) | 8(4) | 20(11) |
| Visibility of the numeric code for a diagnostic term | 3 (60) | 2 (40) | 0 | 5(3) |
| Abbreviations not recognized by users | 2 (67) | 0 | 1(33) | 3(2) |
| Users not clear about the meaning of some concepts | 0 | 4(100) | 0 | 4(2) |
| Some concepts not classified in appropriate categories / sub categories | 2 (100) | 0 | 0 | 2(1) |
| Work domain and workflow related themes | ||||
| Knowledge level of diagnostic term concepts and how to enter in EHR limited | 14(70) | 2(10) | 4(20) | 20(11) |
| Free text option can be used circumvent structured data entry | 7 (58) | 5(42) | 0 | 12(7) |
| Only one diagnosis can be entered for each treatment | 0 | 2(100) | 0 | 2 (1) |
| No decision support to help suggest appropriate diagnoses, or alert if inappropriate ones are selected | 2(100) | 0 | 0 | 2 (1) |
| Synonyms not displayed | 2(100) | 0 | 0 | 2(1) |
| Diagnosis cannot be charted using the Odontogram or Periogram | 0 | 0 | 1(100) | 1(0) |
| No historical view of when a diagnosis has been added or modified | 1(100) | 0 | 0 | 1(0) |
| No way to indicate state of diagnosis (i.e differential, working or definitive) | 0 | 3(100) | 0 | 3(2) |
| Users forced to enter a diagnosis for treatments that may not require them | 1 | 0 | 0 | 1(0) |
| Total: | 99 (54) | 54(28) | 34(18) | 187 (100) |