Table 2.
Summary of engagement measures included in usage data analysis across providers.
| Provider A | Provider C | Provider D | |
|---|---|---|---|
| Self-monitoringa | |||
| Number of times behaviours were self-monitored | ✓ | ✓ | ✓ |
| Number of times outcomes were self-monitored | ✓ | ✓ | ✓ |
| Goal settinga | |||
| Number of times a behavioural and/or outcome goal was set or amended | ✓ | ✓ | ✓ |
| Number of times behavioural goals were set | ✗ | ✓ | ✓ |
| Number of times outcome goals were set | ✗ | ✓ | ✓ |
| Educational content | |||
| Number of times any articles were accessed | ✓ | ✗ | ✓ |
| Number of times unique articles were accessed | ✓ | ✗ | ✓ |
| Number of times educational content was sent from health coach | n/a | ✓ | n/a |
| Health coach support | |||
| Number of calls with health coach | ✓ | ✓ | n/a |
| Number of messages sent to health coach that have been responded to | ✓ | ✗ | ✓ |
| Number of messages sent from service user to health coach (including text, images and videos) | ✗ | ✓ | ✗ |
| Number of support messages sent from health coach (including text, images, links and videos) | ✗ | ✓ | ✗ |
| Group support | |||
| Number of peer messages sent in group chat by service userb | n/a | n/a | ✓ |
| Number of group posts in discussion forum by service userc | n/a | ✓ | ✓ |
| Number of comments on group posts in discussion forum by service userc | n/a | ✓ | ✓ |
| Number of likes on group posts in discussion forum by service userc | n/a | ✓ | ✓ |
| App usage | |||
| Number of minutes spent on the appd | ✓ | ✓ | ✓ |
Note. Provider B was unable to supply usage data for this analysis. Providers are labelled A, C and D to provide anonymisation, but to allow cross-reference to previous papers published by the research team for this programme of work (Hawkes et al., 2022a; Hawkes et al., 2023).
If users self-monitored more than one behaviour/outcome during one individual occasion, or set a goal for more than one behaviour/outcome during one individual occasion, this was reported as individual instances of self-monitoring or goal setting.
Closed peer group chat messaging, also moderated by a health coach.
Open group discussion forums, akin to social media forum.
This measure includes time spent using the intervention features in the app and is therefore considered an overall measure of engagement.
✓ = Provider has supplied this data.
✗ = Provider has not supplied this data but it is part of their digital intervention.
n/a = Not offered as part of the provider's digital intervention at the time of the evaluation.