Table 4.
Quantitative outcomes for phase 1 prototype and phase 2 high-fidelity usability.
| Categorization | Prototype cohort (n=18), mean (SD) | High-fidelity cohort (n=43), mean (SD) | ||||
| SUSa,b: total (0-100); individual items (0-10) | ||||||
|
|
Total | 81.90 (9.80) | 65.76 (15.23) | |||
|
|
I think I would like to use this tool frequently. | 7.64 (2.18) | 7.09 (2.11) | |||
|
|
I found the tool unnecessarily complex. | 8.75 (2.46) | 7.09 (2.11) | |||
|
|
I thought the tool was easy to use. | 8.47 (152) | 6.40 (2.45) | |||
|
|
I think that I would need the support of a technical person to be able to use this tool. | 8.06 (2.79) | 7.03 (2.33) | |||
|
|
I found the various functions in this tool were well integrated. | 8.75 (1.29) | 6.91 (2.17) | |||
|
|
I thought there was too much inconsistency in this tool. | 8.75 (1.96) | 6.57 (2.25) | |||
|
|
I would imagine that most people would learn to use this tool very quickly. | 7.92 (2.46) | 7.26 (1.79) | |||
|
|
I found this tool very cumbersome to use. | 7.92 (3.12) | 6.22 (2.52) | |||
|
|
I felt very confident using the tool. | 8.47 (1.94) | 7.44 (1.87) | |||
|
|
I needed to learn a lot of things before I could get going with this tool. | 7.22 (3.31) | 5.11 (2.67) | |||
| EUCSc,d measure (score 1-5) | ||||||
|
|
Total | 4.30 (0.71) | 3.91 (0.95) | |||
|
|
EUCS content subscale | 4.25 (0.90) | 3.81 (0.93) | |||
|
|
|
Does the web tool provide the precise information you need? | 4.17 (0.99) | 3.81 (1.11) | ||
|
|
|
Does the web tool information content meet your needs? | 4.28 (0.89) | 3.74 (1.03) | ||
|
|
|
Does the web tool provide help that seemed to be just about exactly what you need? | 4.22 (01.17) | 3.67 (1.06) | ||
|
|
|
Did the web tool provide sufficient information? | 4.33 (0.84) | 4.02 (1.01) | ||
|
|
EUCS accuracy subscale | 4.25 (0.83) | 3.87 (1.10) | |||
|
|
|
Was the web tool accurate? | 4.22 (0.88) | 3.86 (1.10) | ||
|
|
|
Were you satisfied with the accuracy of the web tool? | 4.28 (0.89) | 4.05 (0.95) | ||
|
|
EUCS format subscale | 4.28 (0.69) | 3.97 (1.00) | |||
|
|
|
Did you think the web tool information is presented in a useful manner? | 4.28 (1.02) | 4.05 (0.95) | ||
|
|
|
Was the web tool information clear? | 4.28 (0.83) | 4.05 (1.05) | ||
|
|
EUCS ease of use subscale | 4.53 (0.70) | 4.0 (1.02) | |||
|
|
|
Was the web tool user friendly? | 4.5 (0.86) | 4.05 (0.10) | ||
|
|
|
Was the web tool easy to use? | 4.56 (0.62) | 3.95 (1.13) | ||
|
|
EUCS timeliness subscale | 4.25 (0.83) | 3.88 (1.06) | |||
|
|
|
Did you get the web tool information you needed quickly? | 4.28 (0.96) | 3.86 (1.08) | ||
|
|
|
Did the web tool provide up-to-date information? | 4.22 (0.88) | 3.91 (1.11) | ||
| PEe,f tool (score 1-5) | ||||||
|
|
Total score | —g | 4.12 (0.67) | |||
|
|
How well did the tool support you in caring for your health? | — | 4.00 (0.70) | |||
|
|
How well were your concerns about lung cancer screening addressed? | — | 4.27 (0.77) | |||
|
|
How well did you understand the guidelines for lung cancer screening? | — | 4.12 (0.76) | |||
|
|
How well did you understand the information provided about lung cancer screening? | — | 4.14 (0.83) | |||
aSUS: System Usability Scale.
bThe SUS is a 10-item Likert scale with individual item scores ranging from 0 (low usability) to 10 (high usability) and a total score ranging from 0 to 100.
cEUCS: End User Computing Satisfaction.
dThe EUCS is a 12-item scale measuring domains of content, accuracy, format, ease of use, and timeliness.
ePE: Patient Engagement.
fThe PE scale includes four items assessing whether the tool (1) supports users in caring for their health, (2) addresses health concerns, (3) informs users about lung cancer screening guidelines, and (4) informs users about lung cancer screening. Scores on the PE scale range from 1 (low engagement) to 5 (high engagement).
gPatient Engagement was not assessed on the prototype cohort.