Table 2.
Exit Questionnaire Responses
| Sections | Usability Type | Questions | DSD1 | SD2 | NAD3 | SA4 | ASA5 |
|---|---|---|---|---|---|---|---|
| Overall | Ease of Use | I was able to complete my tasks in a reasonable amount of time. | 3 | 4 | 1 | 10 | 83 |
| Ease of Use | Overall the application is easy to use. | 6 | 1 | 5 | 11 | 76 | |
| Ease of Use | It was easy to move from one page to another. | 9 | 4 | 4 | 12 | 70 | |
| Ease of Learning | Terminology used in this application is clear. | 3 | 3 | 1 | 15 | 79 | |
| Ease of Learning | The overall organization of the application is easy to understand. | 6 | 11 | 2 | 24 | 57 | |
| Satisfaction | The content of the application met my expectations. | 5 | 4 | 6 | 20 | 65 | |
| Satisfaction | I would be likely to use this application in the future. | 10 | 4 | 6 | 12 | 68 | |
| Foundations | Ease of Learning | I found the lessons easy to understand. | 1 | 0 | 1 | 10 | 88 |
| Toolbox | Usefulness | I found skills that I practiced routinely. | 4 | 9 | 15 | 30 | 43 |
| Wellness Plan | Satisfaction | I found the idea of a Wellness Plan interesting. | 1 | 1 | 4 | 16 | 78 |
| Usefulness | I actively used the ideas and plans that I developed for managing symptoms in my Awareness & Action section. | 4 | 4 | 5 | 28 | 59 | |
| Usefulness | I actively used the ideas and plans that I developed for my lifestyle skills (SMARTS). | 6 | 5 | 7 | 33 | 48 | |
| Daily Check In | Ease of Use | I found the Daily Check In easy to use. | 4 | 0 | 0 | 5 | 91 |
| Usefulness | I found using the Daily Check In helpful. | 4 | 1 | 4 | 10 | 82 | |
| Using the Daily Check In made me more aware of how much I was sleeping. | 1 | 1 | 1 | 4 | 93 | ||
| Using the Daily Check In made me more aware of my routine. | 4 | 1 | 3 | 10 | 83 | ||
| Using the Daily Check In made me more aware of symptoms and early warning signs. | 4 | 5 | 0 | 14 | 78 | ||
| Using the Daily Check In made me more aware of my medication use. | 9 | 1 | 15 | 5 | 70 | ||
| Daily Review | Ease of Learning | I found the Daily Review easy to understand. | 1 | 1 | 1 | 9 | 88 |
| Usefulness | I often followed up and practiced skills suggested in the Daily Review. | 6 | 14 | 10 | 24 | 47 | |
| Weekly Check In | Ease of Learning | I found the Weekly Survey easy to understand. | 1 | 1 | 4 | 11 | 83 |
| Ease of Use | I (did not have) difficulty remembering or reflecting on if I had symptoms and what symptoms I experienced in the past week. | 28 | 24 | 10 | 11 | 27 | |
| Website | Ease of Learning | I found the LiveWell Clinical Status Summary easy to understand. | 10 | 5 | 30 | 16 | 40 |
| Usefulness | I looked at the LiveWell Clinical Status Summary when I was having problems. | 31 | 14 | 15 | 11 | 30 | |
| I found the LiveWell Clinical Status Summary useful. | 9 | 9 | 35 | 20 | 28 | ||
| I looked at the LiveWell Clinical Status Summary on a regular basis. | 33 | 16 | 14 | 17 | 20 | ||
| Reminder s | Usefulness | I relied on the reminders to complete my daily LiveWell activities. | 15 | 9 | 21 | 11 | 44 |
| Technical | Ease of Use | The battery life of the phone was adequate. | 31 | 14 | 6 | 10 | 40 |
| I used the study phone as I would my primary phone. | 33 | 6 | 17 | 7 | 36 | ||
| I (did not) experience technical issues that impeded my use of the application or study equipment. | 20 | 26 | 19 | 6 | 30 | ||
| I was able to problem solve technical issues that came up on my own. | 11 | 9 | 28 | 24 | 28 | ||
| Coach | Ease of Use | I was able to schedule the coach calls at times that were convenient for me. | 3 | 0 | 5 | 4 | 89 |
| Usefulness | I found the coach supportive. | 3 | 0 | 4 | 6 | 88 | |
| Having the coach calls motivated me to read the lessons. | 3 | 1 | 6 | 11 | 79 | ||
| I found the coach’s role beneficial to my use of the application. | 4 | 0 | 7 | 10 | 79 | ||
| I got more out of the application by working with the coach. | 5 | 3 | 5 | 9 | 79 | ||
| Psychiatrist | Privacy | I was comfortable with my psychiatrist having access to the data collected by the application. | 3 | 1 | 11 | 5 | 80 |
| Usefulness | Using LiveWell helped me communicate with my psychiatrist about how I was doing. | 9 | 1 | 17 | 21 | 52 | |
| Using LiveWell led me to make changes in how I worked with my psychiatrist. | 15 | 9 | 20 | 20 | 37 |
Participant responded to exit questions using a 7-point likert scale: strongly disagree, disagree, somewhat disagree, neither agree nor disagree, somewhat agree, agree, strongly agree. To summarise the data, the responses disagree and strongly disagree were combined and the resposnses agree and strongly agree were combined. The distribution of these combined responses were examined and strongly negatively or positively endorsed questions (Supplement 1) are summarized here and responses to all questions are available in Supplement 2.
1
DSD – disagree/strongly disagree,
2
SD – somewhat disagree,
3
NAD – neither agree nor disagree,
4
SA – somewhat agree,
5
ASA – agree/strongly agree.