1. The chatbot’s personality was realistic and engaging |
3.64 ± 1.24 |
6 |
12.0 |
0 |
0.0 |
14 |
28.0 |
18 |
36.0 |
18 |
36.0 |
2. The chatbot seemed too robotic |
1.82 ± 0.66 |
16 |
32.0 |
27 |
54.0 |
7 |
14 |
0 |
0.0 |
0 |
0.0 |
3. The chatbot was welcoming during initial setup |
4.28 ± 0.67 |
0 |
0.0 |
0 |
0.0 |
6 |
12.0 |
24 |
48.0 |
20 |
40.0 |
4. The chatbot seemed very unfriendly |
1.96 ± 0.67 |
12 |
24.0 |
28 |
56.0 |
10 |
20.0 |
0 |
0.0 |
0 |
0.0 |
5. The chatbot explained its scope and purpose well |
4.06 ± 0.82 |
0 |
0.0 |
0 |
0.0 |
15 |
30.0 |
17 |
34.0 |
18 |
36.0 |
6. The chatbot gave no indication as to its purpose |
1.74± 0.78 |
23 |
46.0 |
17 |
34.0 |
10 |
20.0 |
0 |
0.0 |
0 |
0.0 |
7. The chatbot was easy to navigate |
3.90 ± 1.31 |
6 |
12.0 |
0 |
0.0 |
9 |
18.0 |
13 |
26.0 |
22 |
44.0 |
8. It would be easy to get confused when using the chatbot |
1.78 ± 0.65 |
17 |
34.0 |
27 |
54.0 |
6 |
12.0 |
0 |
0.0 |
0 |
0.0 |
9. The chatbot understood me well |
4.16 ± 0.84 |
0 |
0.0 |
0 |
0.0 |
14 |
28.0 |
14 |
28.0 |
22 |
44.0 |
10. The chatbot failed to recognise a lot of my inputs |
1.98 ± 0.80 |
16 |
32.0 |
19 |
38.0 |
15 |
30.0 |
0 |
0.0 |
0 |
0.0 |
11. Chatbot responses were useful, appropriate and informative |
4.20 ± 0.53 |
0 |
0.0 |
0 |
0.0 |
3 |
6.0 |
34 |
68.0 |
13 |
26.0 |
12. Chatbot responses were irrelevant |
1.90 ± 0.89 |
22 |
44.0 |
11 |
22.0 |
17 |
34.0 |
0 |
0.0 |
0 |
0.0 |
13. The chatbot coped well with any errors or mistakes |
4.26 ± 0.83 |
0 |
0.0 |
0 |
0.0 |
12 |
24.0 |
13 |
26.0 |
25 |
50.0 |
14. The chatbot seemed unable to handle any errors |
2.08 ± 0.83 |
15 |
30.0 |
16 |
32.0 |
19 |
38.0 |
0 |
0.0 |
0 |
0.0 |
15. The chatbot was very easy to use |
4.28 ± 0.57 |
0 |
0.0 |
0 |
0.0 |
3 |
6.0 |
27 |
54.0 |
20 |
40.0 |
16. The chatbot was very complex |
1.58 ± 0.50 |
21 |
42.0 |
29 |
58.0 |
0 |
0.0 |
0 |
0.0 |
0 |
0.0 |
Total score (Mean ± S D)
|
49.94 ± 5.64 |
|
Total mean score after normalizing (SUS score)
|
78.03 ± 8.82 |
|