Table 1.

Scoring system for acceptability and usability of articles.

Study design and measurement			Low	Medium	High
Acceptability
	Quantitativea
		System Usability Scale [12]	<25	25-35	>35+
		Questionnaire for User Interaction Satisfaction [15]	<5	5-7	>7+
		Technology Acceptance Model [16]	<50% agreement	50%-70% agreement	>70% agreement
		In-house survey on the overall dashboard (eg, “the anticoagulation dashboard is necessary for high-quality home health patient care” [17]) and specific dashboard features (eg, “The graph combining edema status and weight is useful [17])	<50% agreement	50%-70% agreement	70%-100% agreement
	Qualitative
		Participant feedback	Negative appraisals (eg, “The tablet is extra work, and for people with dementia, it’s very important for me to give them extra time.” [19])	Containing a mix of both negative and positive comments (eg, “On the right track but not quite there.” [20]; “Whether the system really works remains to be seen. At least it is [better] than nothing.” [21])	Positive appraisal for overall dashboard use (eg, “I find this to be a very helpful tool in a team approach working together with the physician and other team members for the best possible outcomes for our patients” [17]) Positive appraisal for specific dashboard feature (eg, “I have just received one alert, a yellow one, I contacted the older adult the day after...she was happy that it works, and it really works.” [22])
Usability
	Quantitative
		System Usability Scale [12]	<50 (low)	50-70 (medium)	70+ (high)
		Technology Acceptance Model [16]	<50% agreement	50%-70% agreement	>70% agreement
		In-house survey (eg, “The CHF dashboard provides the ease of reviewing necessary patient information at one time.” [17])	<50% agreement	50%-70% agreement	80%-100% agreement
	Qualitative
		Participant feedback	Negative appraisals (eg, “there are no options that we might like to have clicked, that the clients are, for example, chronically or acutely confused.” [19]; “The staff struggled with the challenge of responding to acute events versus detecting trends and patterns of behavioural decline and determining how to integrate such monitoring into their daily schedules” [18])	Mix of appraisals (eg, “We had difficulty logging into the system in the beginning.” [18]; “The system has a learning curve, so training is necessary” but “we can identify fixable usability challenges using scenario based training” [23])	Positive appraisals (eg, “Oh, I love it. I have a sense of being cared for!” [21]; “The electronic form flows nicely. It is set up just like the paper form, is easy to follow and is one less thing on my desk.” [23])

^aAcceptability subscores of the quantitative scales were used to compute the overall acceptability of the dashboards.