Table 6.

Qualitative Usability Results

Themes	Codes	Percentages of participants (number of caregivers and professionals; N = 22)	Examples
Usefulness		100% (17 FC; 6 H)
	Pain Management Strategies	82.6% (14 FC; 5 H)	“There’s information that somebody didn’t know. You don’t have to call a doctor’s office to get that information.” (F6)
	Pain diary helps family caregivers keep track of pain management	69.5% (11 FC; 5 H)	“If [family caregivers] use the diary, it would give an accurate record of how often and to what degree there’s pain, and then what help[s] alleviate it.” (F14)
	Pain diary helps providers adjust treatment regimens	52.1% (9 FC; 3 H)	“If [the care partner] comes for an outpatient appointment … [healthcare providers] can wait to stick with the plan or plan according to the pain diary.” (H1) I think that’s really helpful when you’re talking to the doctor about needing a refill on something. If you have a record of every day this is what’s going on. I know doctors are real nervous about ordering narcotics and refilling them and I understand why that is. I think any documentation that you have in front of you will help you communicate more clearly with the doctor.” (F15)
Ease to use		60.8% (10 FC; 4 H)	“I feel like it’s really easy and simple to use and navigate.” (F8)
Ease of learning		17.3% (4 FC)	“Some of them are significantly less tech savvy. Like they write the steps on the TV kind of thing. I feel like any of them could use this app.” (F11)
Information quality
	Enhancing clarity	78.2% (13 FC; 5 H)	“To make that [the content] a little clearer.” (F2)
	Adding more pain diary input options	47.8% (7 FC; 4 H)	“If [family caregivers are] able to add [their] own [inputs] because there are specific things that my grandma does …” (F11)
	Expanding pain management strategies	30.4% (6 FC; 1 H)	“I feel like maybe adding a more targeted, actionable information” (F1) “I would like to have more information about the importance of pain management.” (F7) “Add more about the side effect” (F8)
	Considering comorbidity in pain management	21.7% (3 FC; 2 H)	“There’s certainly some other types of, um, complications and comorbidity that people have by the time they reached their nineties, eighties that you gotta take into account.” (F4)
	Few Errors/Error Messages	8.6% (2 FC)	“I thought it was pretty dummy proof, which is kind of what you want … if you entered something in error, you could go back and change it, which is great.” (F6)
Interface quality		78% (10 FC; 4 H)
	Aesthetics	43.5% (7 FC; 3 H)	“It was nice and clean, not confusing, not overwhelming. Short and sweet. Because when you’re in the thick of it, you really don’t wanna have to click around all this other stuff or look around and see the little pictures over here and little, because it’s clutter.” (F7)
	Clear layout	21.7% (3 FC; 2 H)	“I like it, it looks really simply. I think the colors are nice … it seems pretty straightforward.” (H7) “It seemed well organized and obviously there’s a great deal of thought that’s gone into this.” (F9)
	Adding more visuals	39.1% (6 FC; 3 H)	“It’s not as easy to read as some of the other pages … [this page] needs a picture.” (F2)
	Adding navigation tools	26.1% (3 FC; 3 H)	“There should be more navigation buttons.” (H4)
	Adding scrolling bars	26.1% (3 FC; 3 H)	“A scroll bar would be really helpful because if you’re trying to look and see what’s going on, it’s kind of hard [without one].” (F2)
	Consistent design	21.7% (5 FC)	“I think there should be consistency in the overall look [of the app].” (F1)
	Offering the PACE-app at a low cost	13% (2 FC; 1 H)	“Is it planning to be Medicare Medicaid approved and insurance approved? I hope it’s low cost.” (F7) “It’s like offering caregivers a lot of resources, Hopefully the cost is low enough that people will still wanna use it.” (H7)
	Add additional functions
	➢Direct coaching on the patient’s pain condition	36.7% (6 FC; 3 H)	“I wish it could coach me a little more … a little more live support, I think would be helpful” (F1)
	➢Share pain diary with healthcare providers	26.1% (2 FC; 4 H)	“Caregivers can have an option to send the pin diary to a provider if they notice something’s different, something’s off. And that could be a function of the web app too.” (H1)
	➢Security—privacy	26.1% (5 FC; 1 H)	“[Including requirements for passwords] that aligned with best practices for data security.” (F1)
	➢Tutorial	21.7% (3 FC; 2 H)	“I think a little more in the tutorial about how to use this app.” (F1)
	➢Download function	17.3% (4 FC)	“It’d be really helpful if there [was] a way to download the strategies or diary either to a Word document or Excel document so that when [family caregivers] go to the doctors with [their] care partners … the doctor can see what [has] been [recorded].” (F2)
	➢Centralized account for multiple family caregivers	17.3% (4 FC)	“I would say that if you’re caring for multiple patients, you may [want to] have the ability to select multiple … patients … for me, both of my parents have dementia.” (F2)
	➢Sending reminders to complete pain diary	13% (2 FC; 1 H)	“I would do for the pain diary is a once-a-week kind of reminder.” (F4)
Satisfaction		39.1% (6 FC; 3 H)	“I think overall I thought it looked really good.” (F2)

Notes: FC = family caregivers; H = healthcare professionals.