Table 2.

Key therapist end-user insights with implications from UX-interviews post beta testing.

Acceptability question	Beta user insight	Implications
Satisfaction with treatment format	• Lacked a clear path that guided participants through treatment. • Too much work directed at suggesting to the patients what to do next.	• Develop “bulletin board” on the start page with “tip of the week” and which treatment week it is. Alpha-test and re-iterate.
Intent to continue use in clinical work	• All therapists wanted to continue using ACTsmart as a clinical tool, as single treatment contact and/or supplement to face-to-face treatment to give/monitor homework and/or reduce number of sessions face-to-face.	• No further development, alpha test or iterations planned based on this feasibility area. • Implementation studies in various clinical settings with varying levels of expertize in clinicians. • Studies on blended care approach combining face-to-face treatment with ACTsmart.
Use of therapist time	• Time consuming to scroll through treatment content to answer content-specific questions. • Inefficient to send text messages from different platform. • Inefficient to need to log in to see new patient activities in treatment, notification function suggested.	• Make content available and searchable from therapist interface. Alpha-test and re-iterate. • Investigate regulatory possibilities to send text messages from treatment platform. • Investigate regulatory possibilities to use push notifications (to patients). • Decision to not notify therapists on all treatment activity by push notifications due to protection of work/life balance.
User friendliness	• Therapists perceived design, format and most content user-friendly for participants but not the on-boarding process. • Therapists perceived the expected work effort for the patients unclear. • Therapists suggest emphasizing that the treatment progress requires patient engagement, e.g. repeated exercises.	• Develop process for on-boarding, including expected work load and level of engagement for patients. Alpha-test and re-iterate. Beta test in clinical trial.
Supports communication with patients	• Sparse communication from some (low activity) patients. • Lacked total overview of patient’s treatment activity due to immaturity of therapist interface which complicated providing specific/relevant feedback.	• Further technical development of therapist interface. Alpha-test and re-iterate. • Rewrite treatment manual with actions to identify and reach inactive patients at earlier stage. • Develop technical solution to flag uncompliant patients. • Alpha-test and re-iterate the above. • Beta-test in clinical trial.